Max level shown:
12024-12-13T21:00:01.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7ee2e78c-8dd5-4027-91e1-2421d8c42457 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22024-12-13T21:00:01.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7ee2e78c-8dd5-4027-91e1-2421d8c42457 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32024-12-13T21:00:01.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7ee2e78c-8dd5-4027-91e1-2421d8c42457 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42024-12-13T21:00:02.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 735cf405-bf3e-4459-88cc-479d459d3c08 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
52024-12-13T21:00:02.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 735cf405-bf3e-4459-88cc-479d459d3c08 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
62024-12-13T21:00:02.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 735cf405-bf3e-4459-88cc-479d459d3c08 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
72024-12-13T21:00:03.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b104c8c1-c248-48cb-95cc-8bb070715c74 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
82024-12-13T21:00:03.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b104c8c1-c248-48cb-95cc-8bb070715c74 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
92024-12-13T21:00:03.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b104c8c1-c248-48cb-95cc-8bb070715c74 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102024-12-13T21:00:04.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b2d2cc7a-433a-4e96-99a8-508b7fb7ab1b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112024-12-13T21:00:04.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b2d2cc7a-433a-4e96-99a8-508b7fb7ab1b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
122024-12-13T21:00:04.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b2d2cc7a-433a-4e96-99a8-508b7fb7ab1b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
132024-12-13T21:00:05.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69171151-2f75-4383-86a2-8d861ffaf849 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
142024-12-13T21:00:05.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69171151-2f75-4383-86a2-8d861ffaf849 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
152024-12-13T21:00:05.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69171151-2f75-4383-86a2-8d861ffaf849 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
162024-12-13T21:00:05.441ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46191
172024-12-13T21:00:05.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46191 req_id = fb0aeaf8-01cf-4688-8161-f94fb2013759 roles = RoleSet { roles: {} } uri = /metrics/producers
182024-12-13T21:00:05.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46191 req_id = fb0aeaf8-01cf-4688-8161-f94fb2013759 resource = Database result = Ok(()) uri = /metrics/producers
192024-12-13T21:00:05.478ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 9808715c-dad7-4981-b1eb-a6013e471643
202024-12-13T21:00:05.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37163 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46191 req_id = fb0aeaf8-01cf-4688-8161-f94fb2013759 response_code = 201 uri = /metrics/producers
212024-12-13T21:00:06.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec2ecc31-155a-4ef3-8367-13d1f01c26c1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
222024-12-13T21:00:06.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec2ecc31-155a-4ef3-8367-13d1f01c26c1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
232024-12-13T21:00:06.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec2ecc31-155a-4ef3-8367-13d1f01c26c1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
242024-12-13T21:00:07.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 40100a4a-cd89-4fa8-9ec3-464f230542a2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
252024-12-13T21:00:07.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 40100a4a-cd89-4fa8-9ec3-464f230542a2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
262024-12-13T21:00:07.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 40100a4a-cd89-4fa8-9ec3-464f230542a2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
272024-12-13T21:00:07.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 7f1afbfb-38e8-497a-8c44-3dcdfd9ccfe8 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
282024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
292024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
302024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
312024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
322024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
332024-12-13T21:00:07.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
342024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
352024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
362024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
372024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
382024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
392024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
402024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
412024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
422024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
442024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
452024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
462024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
472024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
482024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
492024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
502024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
512024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
522024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
532024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
542024-12-13T21:00:07.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
552024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
562024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
572024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
582024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
592024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
602024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
612024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
622024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
632024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
642024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
652024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
662024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
672024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
682024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
692024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
702024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
712024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
722024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
732024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
742024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
752024-12-13T21:00:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
762024-12-13T21:00:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
772024-12-13T21:00:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
782024-12-13T21:00:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
792024-12-13T21:00:07.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
802024-12-13T21:00:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
812024-12-13T21:00:07.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1049, tv_nsec: 240620230 } })
822024-12-13T21:00:07.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
832024-12-13T21:00:07.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.937918ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
842024-12-13T21:00:07.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852024-12-13T21:00:07.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1049, tv_nsec: 242911219 } })
862024-12-13T21:00:07.731ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
872024-12-13T21:00:07.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882024-12-13T21:00:07.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
892024-12-13T21:00:07.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
902024-12-13T21:00:07.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
912024-12-13T21:00:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
922024-12-13T21:00:07.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932024-12-13T21:00:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
942024-12-13T21:00:07.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
952024-12-13T21:00:07.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
962024-12-13T21:00:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
972024-12-13T21:00:07.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
982024-12-13T21:00:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
992024-12-13T21:00:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1002024-12-13T21:00:07.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1012024-12-13T21:00:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1022024-12-13T21:00:07.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1032024-12-13T21:00:07.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1042024-12-13T21:00:07.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1052024-12-13T21:00:07.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1062024-12-13T21:00:07.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1072024-12-13T21:00:07.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1082024-12-13T21:00:07.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1092024-12-13T21:00:07.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1102024-12-13T21:00:07.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1112024-12-13T21:00:07.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1122024-12-13T21:00:07.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1132024-12-13T21:00:07.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1142024-12-13T21:00:07.764ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1152024-12-13T21:00:07.764ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1162024-12-13T21:00:07.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1172024-12-13T21:00:07.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1182024-12-13T21:00:07.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1192024-12-13T21:00:07.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1202024-12-13T21:00:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1212024-12-13T21:00:07.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1222024-12-13T21:00:07.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.013717ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
1232024-12-13T21:00:07.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1242024-12-13T21:00:07.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1252024-12-13T21:00:07.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1262024-12-13T21:00:07.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.510072ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
1272024-12-13T21:00:07.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1282024-12-13T21:00:07.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1292024-12-13T21:00:07.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1302024-12-13T21:00:07.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1312024-12-13T21:00:07.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1322024-12-13T21:00:07.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1332024-12-13T21:00:07.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1342024-12-13T21:00:07.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1352024-12-13T21:00:07.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1362024-12-13T21:00:07.783ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1049, tv_nsec: 295052112 } })
1372024-12-13T21:00:07.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
1382024-12-13T21:00:07.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.667448ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1392024-12-13T21:00:07.786ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1402024-12-13T21:00:07.786ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.480449ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1412024-12-13T21:00:07.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1422024-12-13T21:00:07.793ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1432024-12-13T21:00:07.793ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1442024-12-13T21:00:07.794ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f3cf58d-c6bd-4d8b-abb6-8a5f365b9b1c", "content-length": "26", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
1452024-12-13T21:00:07.794ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1462024-12-13T21:00:07.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
1472024-12-13T21:00:07.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1482024-12-13T21:00:07.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1492024-12-13T21:00:07.796ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1502024-12-13T21:00:07.801ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1512024-12-13T21:00:07.801ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1522024-12-13T21:00:07.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1532024-12-13T21:00:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1542024-12-13T21:00:07.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1552024-12-13T21:00:07.805ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1562024-12-13T21:00:07.805ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41edb7ef-3604-4dc8-9e76-69ff51e6567c", "content-length": "26", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
1572024-12-13T21:00:07.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1582024-12-13T21:00:07.807ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1592024-12-13T21:00:07.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.50612ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1602024-12-13T21:00:07.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1612024-12-13T21:00:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1622024-12-13T21:00:07.810ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
1632024-12-13T21:00:07.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.133138ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
1642024-12-13T21:00:07.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1652024-12-13T21:00:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1662024-12-13T21:00:07.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.847931ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1672024-12-13T21:00:07.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1682024-12-13T21:00:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1692024-12-13T21:00:07.844ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1702024-12-13T21:00:07.844ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1712024-12-13T21:00:07.844ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.415101ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1722024-12-13T21:00:07.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-12-13T21:00:07.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
1742024-12-13T21:00:07.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1752024-12-13T21:00:07.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1762024-12-13T21:00:07.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 126.724517ms iteration = 6 status = 0
1772024-12-13T21:00:07.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1782024-12-13T21:00:07.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1792024-12-13T21:00:07.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.185854ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1802024-12-13T21:00:07.869ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.056296ms iteration = 9 status = {"physical_disks_added":0}
1812024-12-13T21:00:07.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
1822024-12-13T21:00:07.874ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1832024-12-13T21:00:07.875ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "019406f9-4f36-4142-bea6-e6c537da9184", "content-length": "26", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
1842024-12-13T21:00:07.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1852024-12-13T21:00:07.876ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
1862024-12-13T21:00:07.914ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1872024-12-13T21:00:07.914ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5847838a-017f-4ac2-82df-bb575d883ea6", "content-length": "1", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
1882024-12-13T21:00:07.916ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1892024-12-13T21:00:07.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1902024-12-13T21:00:07.918ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 192.910174ms iteration = 6 status = null
1912024-12-13T21:00:07.942ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.779052ms iteration = 6 status = {}
1922024-12-13T21:00:07.944ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1932024-12-13T21:00:07.944ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1942024-12-13T21:00:07.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c375c551-9f96-450d-9f2a-efe25d666a54", "content-length": "372", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
1952024-12-13T21:00:07.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1962024-12-13T21:00:07.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1972024-12-13T21:00:07.958ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
1982024-12-13T21:00:07.958ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1992024-12-13T21:00:07.958ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "02c5ba18-e015-4b4f-bc1c-3492e4630b4e", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
2002024-12-13T21:00:07.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2012024-12-13T21:00:07.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2022024-12-13T21:00:07.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2032024-12-13T21:00:07.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2042024-12-13T21:00:07.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2052024-12-13T21:00:07.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2062024-12-13T21:00:07.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2072024-12-13T21:00:07.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2082024-12-13T21:00:07.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-12-13T21:00:07.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2102024-12-13T21:00:07.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2112024-12-13T21:00:07.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2122024-12-13T21:00:07.976ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2132024-12-13T21:00:07.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2142024-12-13T21:00:07.976ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7712cdb3-797b-4af4-9b1d-4ad0e41ca898", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
2152024-12-13T21:00:07.977ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162024-12-13T21:00:07.978ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.190168ms iteration = 7 status = {}
2172024-12-13T21:00:07.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2182024-12-13T21:00:07.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2192024-12-13T21:00:07.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2202024-12-13T21:00:08.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2212024-12-13T21:00:08.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2222024-12-13T21:00:08.035ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
2232024-12-13T21:00:08.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2242024-12-13T21:00:08.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2252024-12-13T21:00:08.044ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2262024-12-13T21:00:08.044ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd7f8309-8c0d-4264-9009-39462646fbca", "content-length": "134", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
2272024-12-13T21:00:08.044ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2282024-12-13T21:00:08.044ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
2292024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2302024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2312024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2322024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2332024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2342024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2352024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2362024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2372024-12-13T21:00:08.045ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
2382024-12-13T21:00:08.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2392024-12-13T21:00:08.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2402024-12-13T21:00:08.047ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2412024-12-13T21:00:08.047ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b9611f-721c-4bff-8449-6cd86a9e16c4", "content-length": "2", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
2422024-12-13T21:00:08.047ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2432024-12-13T21:00:08.048ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ef76b16-8094-426f-9734-66b565e8e430", "content-length": "52", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
2442024-12-13T21:00:08.048ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
2452024-12-13T21:00:08.048ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2462024-12-13T21:00:08.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2472024-12-13T21:00:08.138ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "20288b83-855e-478a-9dde-fe06e69b391f", "date": "Fri, 13 Dec 2024 21:00:07 GMT"} })
2482024-12-13T21:00:08.138ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
2492024-12-13T21:00:08.138ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2502024-12-13T21:00:08.138ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "adfeb82f-9369-4093-9663-862e16c5938f", "content-length": "682", "date": "Fri, 13 Dec 2024 21:00:08 GMT"} })
2512024-12-13T21:00:08.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2522024-12-13T21:00:08.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2532024-12-13T21:00:08.139ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6496abc4-4529-4762-b60b-83741f482772", "content-length": "691", "date": "Fri, 13 Dec 2024 21:00:08 GMT"} })
2542024-12-13T21:00:08.139ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2552024-12-13T21:00:08.139ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2562024-12-13T21:00:08.139ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2572024-12-13T21:00:08.140ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 415.417515ms iteration = 6 status = {}
2582024-12-13T21:00:08.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2592024-12-13T21:00:08.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2602024-12-13T21:00:08.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2612024-12-13T21:00:08.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2622024-12-13T21:00:08.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2632024-12-13T21:00:08.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2642024-12-13T21:00:08.154ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.183432ms iteration = 6 status = {}
2652024-12-13T21:00:08.220ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44252
2662024-12-13T21:00:08.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44252 req_id = 1f2b6db0-4838-4a75-b9d3-49fe61b3ae7e roles = RoleSet { roles: {} } uri = /metrics/producers
2672024-12-13T21:00:08.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44252 req_id = 1f2b6db0-4838-4a75-b9d3-49fe61b3ae7e resource = Database result = Ok(()) uri = /metrics/producers
2682024-12-13T21:00:08.229ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 05a53e54-a11d-4f9d-b47d-dabf8673427d
2692024-12-13T21:00:08.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9359 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44252 req_id = 1f2b6db0-4838-4a75-b9d3-49fe61b3ae7e response_code = 201 uri = /metrics/producers
2702024-12-13T21:00:08.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5af7ede2-04d8-4d84-8c85-d5eaa5b0e881 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2712024-12-13T21:00:08.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5af7ede2-04d8-4d84-8c85-d5eaa5b0e881 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2722024-12-13T21:00:08.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5af7ede2-04d8-4d84-8c85-d5eaa5b0e881 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2732024-12-13T21:00:09.041ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:34389
2742024-12-13T21:00:09.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34389 req_id = 12bbfdaa-b992-4665-8e95-134b8bcfa852 roles = RoleSet { roles: {} } uri = /metrics/producers
2752024-12-13T21:00:09.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34389 req_id = 12bbfdaa-b992-4665-8e95-134b8bcfa852 resource = Database result = Ok(()) uri = /metrics/producers
2762024-12-13T21:00:09.082ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 82024834-9725-4304-9edd-af6b519041b3
2772024-12-13T21:00:09.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41199 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34389 req_id = 12bbfdaa-b992-4665-8e95-134b8bcfa852 response_code = 201 uri = /metrics/producers
2782024-12-13T21:00:09.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 228b490e-e1fc-41ae-8a9c-40226174d62e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2792024-12-13T21:00:09.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 228b490e-e1fc-41ae-8a9c-40226174d62e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2802024-12-13T21:00:09.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 228b490e-e1fc-41ae-8a9c-40226174d62e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2812024-12-13T21:00:09.293ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44732
2822024-12-13T21:00:09.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44732 req_id = c1efb583-d05d-422e-984d-5bb4e1e6670f roles = RoleSet { roles: {} } uri = /metrics/producers
2832024-12-13T21:00:09.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44732 req_id = c1efb583-d05d-422e-984d-5bb4e1e6670f resource = Database result = Ok(()) uri = /metrics/producers
2842024-12-13T21:00:09.329ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 24d23071-4a22-4662-832b-fb2493a9b66b
2852024-12-13T21:00:09.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35537 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44732 req_id = c1efb583-d05d-422e-984d-5bb4e1e6670f response_code = 201 uri = /metrics/producers
2862024-12-13T21:00:09.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 068f8936-5229-45c0-892e-2f3019842e3a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2872024-12-13T21:00:09.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 068f8936-5229-45c0-892e-2f3019842e3a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2882024-12-13T21:00:09.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 068f8936-5229-45c0-892e-2f3019842e3a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2892024-12-13T21:00:10.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 41f37631-ef32-4c9c-899e-02d82041ed29 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2902024-12-13T21:00:10.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 41f37631-ef32-4c9c-899e-02d82041ed29 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2912024-12-13T21:00:10.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 41f37631-ef32-4c9c-899e-02d82041ed29 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2922024-12-13T21:00:11.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 153653a6-f402-4dd3-99eb-d5506caad1de roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2932024-12-13T21:00:11.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 153653a6-f402-4dd3-99eb-d5506caad1de resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2942024-12-13T21:00:11.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 153653a6-f402-4dd3-99eb-d5506caad1de response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2952024-12-13T21:00:12.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 79b0a53f-4f3c-41b8-89b8-595156ad74e0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2962024-12-13T21:00:12.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 79b0a53f-4f3c-41b8-89b8-595156ad74e0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2972024-12-13T21:00:12.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 79b0a53f-4f3c-41b8-89b8-595156ad74e0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2982024-12-13T21:00:13.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32837b4c-24aa-433c-bba4-ecf321e78fca roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
2992024-12-13T21:00:13.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32837b4c-24aa-433c-bba4-ecf321e78fca resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3002024-12-13T21:00:13.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32837b4c-24aa-433c-bba4-ecf321e78fca response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3012024-12-13T21:00:13.813ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59440
3022024-12-13T21:00:13.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59440 req_id = 2e191236-028b-4fab-96ea-3b1190b54d7d roles = RoleSet { roles: {} } uri = /metrics/producers
3032024-12-13T21:00:13.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59440 req_id = 2e191236-028b-4fab-96ea-3b1190b54d7d resource = Database result = Ok(()) uri = /metrics/producers
3042024-12-13T21:00:13.822ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 3f777322-11c9-4c30-9537-a1cc3a15fe00
3052024-12-13T21:00:13.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9063 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59440 req_id = 2e191236-028b-4fab-96ea-3b1190b54d7d response_code = 201 uri = /metrics/producers
3062024-12-13T21:00:14.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5adac7d8-6eaa-4f03-a1a6-b55d42a4a956 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3072024-12-13T21:00:14.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5adac7d8-6eaa-4f03-a1a6-b55d42a4a956 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3082024-12-13T21:00:14.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5adac7d8-6eaa-4f03-a1a6-b55d42a4a956 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3092024-12-13T21:00:15.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2d991d9e-abcb-4854-ad9d-f8e75a038031 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3102024-12-13T21:00:15.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2d991d9e-abcb-4854-ad9d-f8e75a038031 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3112024-12-13T21:00:15.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2d991d9e-abcb-4854-ad9d-f8e75a038031 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3122024-12-13T21:00:16.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d07a2def-7a0e-4902-884c-bfac46db85a4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3132024-12-13T21:00:16.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d07a2def-7a0e-4902-884c-bfac46db85a4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3142024-12-13T21:00:16.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d07a2def-7a0e-4902-884c-bfac46db85a4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3152024-12-13T21:00:17.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e35a6d6-2c92-412d-bd5b-9fdc2936fc51 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3162024-12-13T21:00:17.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e35a6d6-2c92-412d-bd5b-9fdc2936fc51 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3172024-12-13T21:00:17.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e35a6d6-2c92-412d-bd5b-9fdc2936fc51 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3182024-12-13T21:00:17.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d8653c3c-972f-41e6-82a5-fa7f25724e37 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
3192024-12-13T21:00:17.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
3202024-12-13T21:00:17.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3212024-12-13T21:00:17.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
3222024-12-13T21:00:17.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3232024-12-13T21:00:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3242024-12-13T21:00:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3252024-12-13T21:00:17.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3262024-12-13T21:00:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3272024-12-13T21:00:17.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-12-13T21:00:17.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.798708ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3292024-12-13T21:00:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3302024-12-13T21:00:17.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3312024-12-13T21:00:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3322024-12-13T21:00:17.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3332024-12-13T21:00:17.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3342024-12-13T21:00:17.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352024-12-13T21:00:17.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
3362024-12-13T21:00:17.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3372024-12-13T21:00:17.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3382024-12-13T21:00:17.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
3392024-12-13T21:00:17.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.500094ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
3402024-12-13T21:00:18.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02652c0d-17d5-4ee4-84f4-32f8930a1683 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3412024-12-13T21:00:18.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02652c0d-17d5-4ee4-84f4-32f8930a1683 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3422024-12-13T21:00:18.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02652c0d-17d5-4ee4-84f4-32f8930a1683 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3432024-12-13T21:00:19.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3c2ce11b-24f7-4434-998c-d398cc6b36e0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3442024-12-13T21:00:19.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3c2ce11b-24f7-4434-998c-d398cc6b36e0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3452024-12-13T21:00:19.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3c2ce11b-24f7-4434-998c-d398cc6b36e0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3462024-12-13T21:00:20.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ffddf31a-1135-40d5-8f0e-a38be2660770 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3472024-12-13T21:00:20.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ffddf31a-1135-40d5-8f0e-a38be2660770 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3482024-12-13T21:00:20.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ffddf31a-1135-40d5-8f0e-a38be2660770 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3492024-12-13T21:00:21.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 692406a6-c1b3-4a9c-9a3b-0ab6d7b3dda1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3502024-12-13T21:00:21.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 692406a6-c1b3-4a9c-9a3b-0ab6d7b3dda1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3512024-12-13T21:00:21.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 692406a6-c1b3-4a9c-9a3b-0ab6d7b3dda1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3522024-12-13T21:00:22.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 97820b10-57d6-4265-80fe-0592156050d8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3532024-12-13T21:00:22.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 97820b10-57d6-4265-80fe-0592156050d8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3542024-12-13T21:00:22.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 97820b10-57d6-4265-80fe-0592156050d8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3552024-12-13T21:00:23.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f68eef05-0026-47c4-9928-383d96d36376 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3562024-12-13T21:00:23.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f68eef05-0026-47c4-9928-383d96d36376 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3572024-12-13T21:00:23.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f68eef05-0026-47c4-9928-383d96d36376 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3582024-12-13T21:00:24.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 471b6199-1bd8-4cad-817a-ad5f10bb84d3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3592024-12-13T21:00:24.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 471b6199-1bd8-4cad-817a-ad5f10bb84d3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3602024-12-13T21:00:24.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 471b6199-1bd8-4cad-817a-ad5f10bb84d3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3612024-12-13T21:00:25.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d68c665e-577d-43bd-b42f-5cd2e0bb0d67 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3622024-12-13T21:00:25.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d68c665e-577d-43bd-b42f-5cd2e0bb0d67 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3632024-12-13T21:00:25.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d68c665e-577d-43bd-b42f-5cd2e0bb0d67 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3642024-12-13T21:00:26.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6cf08c88-cb48-426d-8821-14a6d369b9ee roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3652024-12-13T21:00:26.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6cf08c88-cb48-426d-8821-14a6d369b9ee resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3662024-12-13T21:00:26.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6cf08c88-cb48-426d-8821-14a6d369b9ee response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3672024-12-13T21:00:26.853ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:38975
3682024-12-13T21:00:26.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38975 req_id = df326785-02c8-4173-8048-f241fa80760a roles = RoleSet { roles: {} } uri = /metrics/producers
3692024-12-13T21:00:26.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38975 req_id = df326785-02c8-4173-8048-f241fa80760a resource = Database result = Ok(()) uri = /metrics/producers
3702024-12-13T21:00:26.863ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 80dcafa7-ddfc-4f6b-a596-bd2a7d203daf
3712024-12-13T21:00:26.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9329 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38975 req_id = df326785-02c8-4173-8048-f241fa80760a response_code = 201 uri = /metrics/producers
3722024-12-13T21:00:27.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1200 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f928f271-dc8d-4128-b928-3d907e7ad741 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
3732024-12-13T21:00:27.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
3742024-12-13T21:00:27.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
3752024-12-13T21:00:27.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3762024-12-13T21:00:27.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3772024-12-13T21:00:27.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 14c1a243-ebfa-497c-97cb-6c87792641f5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3782024-12-13T21:00:27.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3792024-12-13T21:00:27.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3802024-12-13T21:00:27.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 14c1a243-ebfa-497c-97cb-6c87792641f5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3812024-12-13T21:00:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3822024-12-13T21:00:27.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3832024-12-13T21:00:27.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3842024-12-13T21:00:27.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 14c1a243-ebfa-497c-97cb-6c87792641f5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3852024-12-13T21:00:27.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3862024-12-13T21:00:27.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3872024-12-13T21:00:27.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3882024-12-13T21:00:27.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3892024-12-13T21:00:27.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3902024-12-13T21:00:27.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3912024-12-13T21:00:27.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
3922024-12-13T21:00:27.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3932024-12-13T21:00:27.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3942024-12-13T21:00:27.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
3952024-12-13T21:00:27.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.988816ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
3962024-12-13T21:00:27.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.708696ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3972024-12-13T21:00:28.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 128ea7b2-00e9-4630-9808-d540e7470a17 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3982024-12-13T21:00:28.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 128ea7b2-00e9-4630-9808-d540e7470a17 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
3992024-12-13T21:00:28.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 128ea7b2-00e9-4630-9808-d540e7470a17 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4002024-12-13T21:00:29.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e776167-c563-4e64-b6b8-855f05551d68 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4012024-12-13T21:00:29.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e776167-c563-4e64-b6b8-855f05551d68 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4022024-12-13T21:00:29.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e776167-c563-4e64-b6b8-855f05551d68 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4032024-12-13T21:00:30.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9137bdc7-aedd-4dce-8a5c-c1fafa91e72d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4042024-12-13T21:00:30.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9137bdc7-aedd-4dce-8a5c-c1fafa91e72d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4052024-12-13T21:00:30.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9137bdc7-aedd-4dce-8a5c-c1fafa91e72d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4062024-12-13T21:00:31.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec31fefa-963a-41d9-a435-a50d94283e8e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4072024-12-13T21:00:31.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec31fefa-963a-41d9-a435-a50d94283e8e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4082024-12-13T21:00:31.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec31fefa-963a-41d9-a435-a50d94283e8e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4092024-12-13T21:00:32.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f988125c-0d8a-4bd0-b186-0eb5bc8cfd43 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4102024-12-13T21:00:32.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f988125c-0d8a-4bd0-b186-0eb5bc8cfd43 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4112024-12-13T21:00:32.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f988125c-0d8a-4bd0-b186-0eb5bc8cfd43 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4122024-12-13T21:00:33.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9036ce67-b254-4c0d-b169-bdfcfc39744c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4132024-12-13T21:00:33.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9036ce67-b254-4c0d-b169-bdfcfc39744c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4142024-12-13T21:00:33.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9036ce67-b254-4c0d-b169-bdfcfc39744c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4152024-12-13T21:00:34.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11ea954b-efeb-4112-b655-7aa1c244a220 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4162024-12-13T21:00:34.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11ea954b-efeb-4112-b655-7aa1c244a220 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4172024-12-13T21:00:34.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11ea954b-efeb-4112-b655-7aa1c244a220 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4182024-12-13T21:00:35.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fb0a4bb1-a51b-44e5-857b-f8c663f091bd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4192024-12-13T21:00:35.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fb0a4bb1-a51b-44e5-857b-f8c663f091bd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4202024-12-13T21:00:35.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fb0a4bb1-a51b-44e5-857b-f8c663f091bd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4212024-12-13T21:00:36.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78328933-bf51-40cf-b4b0-b62c079182f5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4222024-12-13T21:00:36.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78328933-bf51-40cf-b4b0-b62c079182f5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4232024-12-13T21:00:36.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78328933-bf51-40cf-b4b0-b62c079182f5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
4242024-12-13T21:00:37.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6d0fed10-3991-4d35-8406-24960d0f26d3 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
4252024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
4262024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4272024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
4282024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
4292024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4302024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
4312024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
4322024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4332024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
4342024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4352024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4362024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
4372024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4382024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
4392024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4402024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
4412024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
4422024-12-13T21:00:37.725ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
4432024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.5\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
4442024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
4452024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
4462024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4472024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
4482024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
4492024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4502024-12-13T21:00:37.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4512024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
4522024-12-13T21:00:37.725ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4532024-12-13T21:00:37.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4542024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4552024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
4562024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4572024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
4582024-12-13T21:00:37.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:50:37.725837819 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4592024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4602024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
4612024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4622024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
4632024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4642024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4652024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
4662024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
4672024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4682024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4692024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
4702024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4712024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
4722024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
4732024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4742024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4752024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4762024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
4772024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4782024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4792024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
4802024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4812024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
4822024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
4832024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4842024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4852024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
4862024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4872024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
4882024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4892024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4902024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
4912024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4922024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4932024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4942024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4952024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4962024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4972024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4982024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4992024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5002024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5012024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5022024-12-13T21:00:37.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 238341044 } })
5032024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5042024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5052024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5062024-12-13T21:00:37.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 238380605 } })
5072024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5082024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5092024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5102024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5112024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5122024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5132024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5142024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5152024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5162024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5172024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5182024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5192024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5202024-12-13T21:00:37.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5212024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5222024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5232024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5242024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.54004ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5252024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5262024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.417747ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5272024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5282024-12-13T21:00:37.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292024-12-13T21:00:37.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 240407217 } })
5302024-12-13T21:00:37.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5312024-12-13T21:00:37.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322024-12-13T21:00:37.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332024-12-13T21:00:37.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.217179ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5342024-12-13T21:00:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5352024-12-13T21:00:37.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5362024-12-13T21:00:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5372024-12-13T21:00:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5382024-12-13T21:00:37.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5392024-12-13T21:00:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5402024-12-13T21:00:37.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5412024-12-13T21:00:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5422024-12-13T21:00:37.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5432024-12-13T21:00:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5442024-12-13T21:00:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5452024-12-13T21:00:37.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5462024-12-13T21:00:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5472024-12-13T21:00:37.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 247024559 } })
5482024-12-13T21:00:37.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5492024-12-13T21:00:37.735ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5502024-12-13T21:00:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5512024-12-13T21:00:37.736ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:50:37.725837819 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5522024-12-13T21:00:37.736ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.169544ms iteration = 4 status = {"expiration":"2024-12-13T20:50:37.725837819Z","pruned":[]}
5532024-12-13T21:00:37.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5542024-12-13T21:00:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5552024-12-13T21:00:37.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562024-12-13T21:00:37.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.836303ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
5572024-12-13T21:00:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5582024-12-13T21:00:37.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5592024-12-13T21:00:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5602024-12-13T21:00:37.778ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-12-13T21:00:37.780ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5622024-12-13T21:00:37.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5632024-12-13T21:00:37.780ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5642024-12-13T21:00:37.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5652024-12-13T21:00:37.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5662024-12-13T21:00:37.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5672024-12-13T21:00:37.782ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5682024-12-13T21:00:37.782ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692024-12-13T21:00:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5702024-12-13T21:00:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5712024-12-13T21:00:37.784ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 295793694 } })
5722024-12-13T21:00:37.784ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
5732024-12-13T21:00:37.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5742024-12-13T21:00:37.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5752024-12-13T21:00:37.784ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5762024-12-13T21:00:37.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5772024-12-13T21:00:37.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5782024-12-13T21:00:37.785ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5792024-12-13T21:00:37.785ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5802024-12-13T21:00:37.785ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.639366ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5812024-12-13T21:00:37.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5822024-12-13T21:00:37.787ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5832024-12-13T21:00:37.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.076434ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
5842024-12-13T21:00:37.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5852024-12-13T21:00:37.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-12-13T21:00:37.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872024-12-13T21:00:37.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5882024-12-13T21:00:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5892024-12-13T21:00:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5902024-12-13T21:00:37.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5912024-12-13T21:00:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5922024-12-13T21:00:37.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5932024-12-13T21:00:37.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5942024-12-13T21:00:37.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5952024-12-13T21:00:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5962024-12-13T21:00:37.791ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-12-13T21:00:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5982024-12-13T21:00:37.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5992024-12-13T21:00:37.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6002024-12-13T21:00:37.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6012024-12-13T21:00:37.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.806593ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6022024-12-13T21:00:37.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6032024-12-13T21:00:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6042024-12-13T21:00:37.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6052024-12-13T21:00:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6062024-12-13T21:00:37.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072024-12-13T21:00:37.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6082024-12-13T21:00:37.796ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6092024-12-13T21:00:37.796ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6102024-12-13T21:00:37.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6112024-12-13T21:00:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6122024-12-13T21:00:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6132024-12-13T21:00:37.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6142024-12-13T21:00:37.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6152024-12-13T21:00:37.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6162024-12-13T21:00:37.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6172024-12-13T21:00:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6182024-12-13T21:00:37.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6192024-12-13T21:00:37.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6202024-12-13T21:00:37.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6212024-12-13T21:00:37.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-12-13T21:00:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6232024-12-13T21:00:37.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6242024-12-13T21:00:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6252024-12-13T21:00:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6262024-12-13T21:00:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6272024-12-13T21:00:37.807ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.940446ms iteration = 3 status = {"nsuccess":5}
6282024-12-13T21:00:37.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292024-12-13T21:00:37.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6302024-12-13T21:00:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6312024-12-13T21:00:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6322024-12-13T21:00:37.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6332024-12-13T21:00:37.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6342024-12-13T21:00:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6352024-12-13T21:00:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6362024-12-13T21:00:37.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6372024-12-13T21:00:37.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6382024-12-13T21:00:37.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6392024-12-13T21:00:37.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6402024-12-13T21:00:37.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.474618ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6412024-12-13T21:00:37.825ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6422024-12-13T21:00:37.825ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6432024-12-13T21:00:37.825ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6442024-12-13T21:00:37.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6452024-12-13T21:00:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6462024-12-13T21:00:37.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472024-12-13T21:00:37.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6482024-12-13T21:00:37.833ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6492024-12-13T21:00:37.833ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.759065ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6502024-12-13T21:00:37.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6512024-12-13T21:00:37.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6522024-12-13T21:00:37.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6532024-12-13T21:00:37.834ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6542024-12-13T21:00:37.834ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6552024-12-13T21:00:37.834ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 108.993057ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6562024-12-13T21:00:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
6572024-12-13T21:00:37.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6582024-12-13T21:00:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6592024-12-13T21:00:37.838ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6602024-12-13T21:00:37.838ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6612024-12-13T21:00:37.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6622024-12-13T21:00:37.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6632024-12-13T21:00:37.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6642024-12-13T21:00:37.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6652024-12-13T21:00:37.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.752268ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6662024-12-13T21:00:37.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672024-12-13T21:00:37.853ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 127.60653ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
6682024-12-13T21:00:37.854ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
6692024-12-13T21:00:37.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.002266ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
6702024-12-13T21:00:37.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6712024-12-13T21:00:37.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6722024-12-13T21:00:37.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6732024-12-13T21:00:37.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6742024-12-13T21:00:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6752024-12-13T21:00:37.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6762024-12-13T21:00:37.859ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6772024-12-13T21:00:37.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782024-12-13T21:00:37.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6792024-12-13T21:00:37.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6802024-12-13T21:00:37.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6812024-12-13T21:00:37.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
6822024-12-13T21:00:37.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6832024-12-13T21:00:37.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6842024-12-13T21:00:37.866ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 140.883064ms iteration = 7 status = 0
6852024-12-13T21:00:37.867ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6862024-12-13T21:00:37.867ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
6872024-12-13T21:00:37.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6882024-12-13T21:00:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6892024-12-13T21:00:37.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902024-12-13T21:00:37.871ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6912024-12-13T21:00:37.871ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6922024-12-13T21:00:37.871ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6932024-12-13T21:00:37.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6942024-12-13T21:00:37.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6952024-12-13T21:00:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6962024-12-13T21:00:37.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6972024-12-13T21:00:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6982024-12-13T21:00:37.874ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
6992024-12-13T21:00:37.874ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7002024-12-13T21:00:37.874ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
7012024-12-13T21:00:37.874ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.753228ms iteration = 5 status = {"generation":2}
7022024-12-13T21:00:37.875ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7032024-12-13T21:00:37.875ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7042024-12-13T21:00:37.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.673563ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7052024-12-13T21:00:37.879ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7062024-12-13T21:00:37.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.334147ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7072024-12-13T21:00:37.919ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
7082024-12-13T21:00:37.919ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 193.337585ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7092024-12-13T21:00:37.924ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7102024-12-13T21:00:37.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.265828ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7112024-12-13T21:00:37.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122024-12-13T21:00:37.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7132024-12-13T21:00:37.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7142024-12-13T21:00:37.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7152024-12-13T21:00:37.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7162024-12-13T21:00:37.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7172024-12-13T21:00:37.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0c248493-6848-401d-8e51-4afe45821142 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
7182024-12-13T21:00:37.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0c248493-6848-401d-8e51-4afe45821142 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
7192024-12-13T21:00:37.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-12-13T21:00:37.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7212024-12-13T21:00:37.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7222024-12-13T21:00:37.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7232024-12-13T21:00:37.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242024-12-13T21:00:37.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7252024-12-13T21:00:37.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7262024-12-13T21:00:37.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7272024-12-13T21:00:37.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0c248493-6848-401d-8e51-4afe45821142 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
7282024-12-13T21:00:37.961ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.833517ms iteration = 10 status = {"physical_disks_added":0}
7292024-12-13T21:00:37.973ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7302024-12-13T21:00:37.973ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7312024-12-13T21:00:37.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7322024-12-13T21:00:37.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7332024-12-13T21:00:38.041ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7342024-12-13T21:00:38.041ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7352024-12-13T21:00:38.042ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaad808e-303d-4e8c-91f5-9b253357738d", "content-length": "26", "date": "Fri, 13 Dec 2024 21:00:37 GMT"} })
7362024-12-13T21:00:38.042ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7372024-12-13T21:00:38.044ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7382024-12-13T21:00:38.055ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7392024-12-13T21:00:38.055ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b7eac346-4625-4e23-83c5-05d8953e7880", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7402024-12-13T21:00:38.055ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7412024-12-13T21:00:38.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5140d839-ea17-41e0-9b00-60b6fe76fb27", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7422024-12-13T21:00:38.057ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7432024-12-13T21:00:38.059ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7442024-12-13T21:00:38.059ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 333.177542ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7452024-12-13T21:00:38.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7462024-12-13T21:00:38.098ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7472024-12-13T21:00:38.098ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7482024-12-13T21:00:38.098ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4adb5026-487d-4dad-b24b-6d62136d2505", "content-length": "26", "date": "Fri, 13 Dec 2024 21:00:37 GMT"} })
7492024-12-13T21:00:38.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7502024-12-13T21:00:38.100ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7512024-12-13T21:00:38.125ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
7522024-12-13T21:00:38.125ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7532024-12-13T21:00:38.125ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b0fa40d-e242-4700-a392-f83d60784a64", "content-length": "26", "date": "Fri, 13 Dec 2024 21:00:37 GMT"} })
7542024-12-13T21:00:38.125ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7552024-12-13T21:00:38.127ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
7562024-12-13T21:00:38.185ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7572024-12-13T21:00:38.185ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7582024-12-13T21:00:38.186ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b46fea69-7262-4ff8-be0d-cd90e62e627e", "content-length": "372", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
7592024-12-13T21:00:38.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7602024-12-13T21:00:38.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7612024-12-13T21:00:38.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622024-12-13T21:00:38.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7632024-12-13T21:00:38.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7642024-12-13T21:00:38.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7652024-12-13T21:00:38.195ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7662024-12-13T21:00:38.195ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7672024-12-13T21:00:38.195ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
7682024-12-13T21:00:38.195ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 469.874508ms iteration = 5 status = {"generation":1}
7692024-12-13T21:00:38.220ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7702024-12-13T21:00:38.220ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "70f3e523-0c4a-4714-b462-48ee446f743d", "content-length": "691", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
7712024-12-13T21:00:38.220ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7722024-12-13T21:00:38.220ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7732024-12-13T21:00:38.220ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7742024-12-13T21:00:38.222ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 496.504348ms iteration = 7 status = {}
7752024-12-13T21:00:38.234ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7762024-12-13T21:00:38.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7772024-12-13T21:00:38.235ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b6f4db05-b502-4f5b-82ea-83e30b7c8ff2", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
7782024-12-13T21:00:38.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7792024-12-13T21:00:38.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7802024-12-13T21:00:38.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7812024-12-13T21:00:38.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7822024-12-13T21:00:38.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7832024-12-13T21:00:38.239ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "74263f33-467f-4dcb-845c-218f1eeccca8", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7842024-12-13T21:00:38.239ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7852024-12-13T21:00:38.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7862024-12-13T21:00:38.240ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d5a3ee43-3f88-4116-8512-4bb2bf69af40", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7872024-12-13T21:00:38.240ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7882024-12-13T21:00:38.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7892024-12-13T21:00:38.242ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e3dfa3c8-1e90-45ed-a0ed-eeed84f01683", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7902024-12-13T21:00:38.242ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7912024-12-13T21:00:38.243ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7922024-12-13T21:00:38.243ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7932024-12-13T21:00:38.244ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fb42368a-c915-4864-8a54-9c696a1fab19", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
7942024-12-13T21:00:38.244ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7952024-12-13T21:00:38.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.160977ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7962024-12-13T21:00:38.246ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 520.687956ms iteration = 8 status = {}
7972024-12-13T21:00:38.256ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7982024-12-13T21:00:38.256ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dc3847f-2254-4efd-8d1e-6398bf1bc1cf", "content-length": "1", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
7992024-12-13T21:00:38.258ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8002024-12-13T21:00:38.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8012024-12-13T21:00:38.259ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 534.226517ms iteration = 7 status = null
8022024-12-13T21:00:38.267ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 541.648449ms iteration = 7 status = {}
8032024-12-13T21:00:38.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8042024-12-13T21:00:38.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8052024-12-13T21:00:38.327ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
8062024-12-13T21:00:38.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8072024-12-13T21:00:38.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8082024-12-13T21:00:38.338ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8092024-12-13T21:00:38.338ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e51e7fc2-3c35-4937-8c1f-502a02fd1541", "content-length": "134", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
8102024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8112024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
8122024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8132024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8142024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8152024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8162024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8172024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8182024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8192024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8202024-12-13T21:00:38.338ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
8212024-12-13T21:00:38.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8222024-12-13T21:00:38.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8232024-12-13T21:00:38.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8242024-12-13T21:00:38.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "346ceaa9-d506-45ab-9d05-50ee8f441cd2", "content-length": "2", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
8252024-12-13T21:00:38.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8262024-12-13T21:00:38.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "10c4d8fe-a454-4e5e-bca4-0781176f994a", "content-length": "52", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
8272024-12-13T21:00:38.341ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
8282024-12-13T21:00:38.341ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8292024-12-13T21:00:38.435ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7ee24850-533e-4d4f-b890-f40b03d25705", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
8302024-12-13T21:00:38.435ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
8312024-12-13T21:00:38.435ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8322024-12-13T21:00:38.438ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "66edfbe0-0576-454e-a402-44c5e349a2cf", "content-length": "682", "date": "Fri, 13 Dec 2024 21:00:38 GMT"} })
8332024-12-13T21:00:38.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8342024-12-13T21:00:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8352024-12-13T21:00:38.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8362024-12-13T21:00:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8372024-12-13T21:00:38.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8382024-12-13T21:00:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8392024-12-13T21:00:38.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8402024-12-13T21:00:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8412024-12-13T21:00:38.456ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.630481ms iteration = 7 status = {}
8422024-12-13T21:00:38.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9f098630-cc55-46d0-a88d-0d758d4c59f6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8432024-12-13T21:00:38.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9f098630-cc55-46d0-a88d-0d758d4c59f6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8442024-12-13T21:00:38.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9f098630-cc55-46d0-a88d-0d758d4c59f6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8452024-12-13T21:00:39.003ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
8462024-12-13T21:00:39.003ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
8472024-12-13T21:00:39.034ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
8482024-12-13T21:00:39.034ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60599
8492024-12-13T21:00:39.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60599 req_id = 736f9eb8-2bee-4230-a158-f4cdc437b28b roles = RoleSet { roles: {} } uri = /metrics/producers
8502024-12-13T21:00:39.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60599 req_id = 736f9eb8-2bee-4230-a158-f4cdc437b28b resource = Database result = Ok(()) uri = /metrics/producers
8512024-12-13T21:00:39.044ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 0599e804-8800-4951-9d87-7a8a49a507a3
8522024-12-13T21:00:39.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10031 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60599 req_id = 736f9eb8-2bee-4230-a158-f4cdc437b28b response_code = 201 uri = /metrics/producers
8532024-12-13T21:00:39.044ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "736f9eb8-2bee-4230-a158-f4cdc437b28b", "content-length": "41", "date": "Fri, 13 Dec 2024 21:00:39 GMT"} })
8542024-12-13T21:00:39.045ZDEBGnexus (producer-registration-task): registered with nexus successfully
8552024-12-13T21:00:39.045ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
8562024-12-13T21:00:39.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 46e79f8a-c125-46dd-a9de-44d86a927bd1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8572024-12-13T21:00:39.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 46e79f8a-c125-46dd-a9de-44d86a927bd1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8582024-12-13T21:00:39.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 46e79f8a-c125-46dd-a9de-44d86a927bd1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8592024-12-13T21:00:39.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c10f979b-0649-48a9-98db-6eda8b2f54c7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8602024-12-13T21:00:39.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c10f979b-0649-48a9-98db-6eda8b2f54c7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8612024-12-13T21:00:39.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c10f979b-0649-48a9-98db-6eda8b2f54c7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8622024-12-13T21:00:41.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7fe0ee6d-630d-402c-9b20-101b5867b6e8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8632024-12-13T21:00:41.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7fe0ee6d-630d-402c-9b20-101b5867b6e8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8642024-12-13T21:00:41.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7fe0ee6d-630d-402c-9b20-101b5867b6e8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8652024-12-13T21:00:42.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9748766-9e41-4c09-92b9-d464cc9afafe roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8662024-12-13T21:00:42.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9748766-9e41-4c09-92b9-d464cc9afafe resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8672024-12-13T21:00:42.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9748766-9e41-4c09-92b9-d464cc9afafe response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8682024-12-13T21:00:43.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 30362f30-3aa1-424d-a22e-e47befefbe13 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8692024-12-13T21:00:43.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 30362f30-3aa1-424d-a22e-e47befefbe13 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8702024-12-13T21:00:43.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 30362f30-3aa1-424d-a22e-e47befefbe13 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8712024-12-13T21:00:44.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bd280b4a-129e-42a7-919c-151c0d9fbf09 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8722024-12-13T21:00:44.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bd280b4a-129e-42a7-919c-151c0d9fbf09 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8732024-12-13T21:00:44.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bd280b4a-129e-42a7-919c-151c0d9fbf09 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8742024-12-13T21:00:45.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 335a1f26-d783-4b18-8076-b642134bafc8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8752024-12-13T21:00:45.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 335a1f26-d783-4b18-8076-b642134bafc8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8762024-12-13T21:00:45.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 335a1f26-d783-4b18-8076-b642134bafc8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8772024-12-13T21:00:46.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fff862d-d617-4099-9668-a3adce3eca58 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8782024-12-13T21:00:46.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fff862d-d617-4099-9668-a3adce3eca58 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8792024-12-13T21:00:46.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fff862d-d617-4099-9668-a3adce3eca58 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8802024-12-13T21:00:47.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bdfafb69-559c-4f6f-985a-db196dcf6c56 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8812024-12-13T21:00:47.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bdfafb69-559c-4f6f-985a-db196dcf6c56 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8822024-12-13T21:00:47.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bdfafb69-559c-4f6f-985a-db196dcf6c56 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
8832024-12-13T21:00:47.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1359 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = bc484275-1c41-4530-ae15-bb262277fc7d response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
8842024-12-13T21:00:47.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
8852024-12-13T21:00:47.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8862024-12-13T21:00:47.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
8872024-12-13T21:00:47.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8882024-12-13T21:00:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8892024-12-13T21:00:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8902024-12-13T21:00:47.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8912024-12-13T21:00:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8922024-12-13T21:00:47.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-12-13T21:00:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8942024-12-13T21:00:47.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8952024-12-13T21:00:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8962024-12-13T21:00:47.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8972024-12-13T21:00:47.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8982024-12-13T21:00:47.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992024-12-13T21:00:47.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
9002024-12-13T21:00:47.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9012024-12-13T21:00:47.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9022024-12-13T21:00:47.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
9032024-12-13T21:00:47.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.459506ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
9042024-12-13T21:00:47.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.241518ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9052024-12-13T21:00:48.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d42c4df3-9739-440d-87a6-91e77447302f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9062024-12-13T21:00:48.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d42c4df3-9739-440d-87a6-91e77447302f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9072024-12-13T21:00:48.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d42c4df3-9739-440d-87a6-91e77447302f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9082024-12-13T21:00:49.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cdc7c85f-f18e-4d54-a386-be782d34a004 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9092024-12-13T21:00:49.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cdc7c85f-f18e-4d54-a386-be782d34a004 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9102024-12-13T21:00:49.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cdc7c85f-f18e-4d54-a386-be782d34a004 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9112024-12-13T21:00:50.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d6d6aeae-1f97-444e-88dc-7202daae49eb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9122024-12-13T21:00:50.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d6d6aeae-1f97-444e-88dc-7202daae49eb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9132024-12-13T21:00:50.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d6d6aeae-1f97-444e-88dc-7202daae49eb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9142024-12-13T21:00:51.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bf51241b-b6ce-45f4-90a6-c6f4fb1a699d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9152024-12-13T21:00:51.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bf51241b-b6ce-45f4-90a6-c6f4fb1a699d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9162024-12-13T21:00:51.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bf51241b-b6ce-45f4-90a6-c6f4fb1a699d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9172024-12-13T21:00:52.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cfb47362-aeca-40ce-8c46-8d10d4ddb03e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9182024-12-13T21:00:52.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cfb47362-aeca-40ce-8c46-8d10d4ddb03e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9192024-12-13T21:00:52.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cfb47362-aeca-40ce-8c46-8d10d4ddb03e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9202024-12-13T21:00:53.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ab786fcf-0e84-410c-aa5c-e57024bc1db8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9212024-12-13T21:00:53.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ab786fcf-0e84-410c-aa5c-e57024bc1db8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9222024-12-13T21:00:53.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ab786fcf-0e84-410c-aa5c-e57024bc1db8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9232024-12-13T21:00:54.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32e37dfa-ec5a-4ae2-a644-92d0fe5769ac roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9242024-12-13T21:00:54.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32e37dfa-ec5a-4ae2-a644-92d0fe5769ac resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9252024-12-13T21:00:54.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32e37dfa-ec5a-4ae2-a644-92d0fe5769ac response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9262024-12-13T21:00:55.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f7704799-2baf-4915-b32e-fd25f9e26de4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9272024-12-13T21:00:55.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f7704799-2baf-4915-b32e-fd25f9e26de4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9282024-12-13T21:00:55.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f7704799-2baf-4915-b32e-fd25f9e26de4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9292024-12-13T21:00:56.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 445583fa-d298-4538-8e83-47949ddfc4af roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9302024-12-13T21:00:56.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 445583fa-d298-4538-8e83-47949ddfc4af resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9312024-12-13T21:00:56.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 445583fa-d298-4538-8e83-47949ddfc4af response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9322024-12-13T21:00:57.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = afde11ea-6b86-4e63-a572-e30fd724327b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9332024-12-13T21:00:57.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = afde11ea-6b86-4e63-a572-e30fd724327b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9342024-12-13T21:00:57.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = afde11ea-6b86-4e63-a572-e30fd724327b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9352024-12-13T21:00:57.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1341 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a33e5c4e-eb6c-4f96-b6ba-bee56bb0ec01 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
9362024-12-13T21:00:57.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
9372024-12-13T21:00:57.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9382024-12-13T21:00:57.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
9392024-12-13T21:00:57.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9402024-12-13T21:00:57.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9412024-12-13T21:00:57.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9422024-12-13T21:00:57.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9432024-12-13T21:00:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9442024-12-13T21:00:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452024-12-13T21:00:57.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.904111ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9462024-12-13T21:00:57.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9472024-12-13T21:00:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9482024-12-13T21:00:57.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9492024-12-13T21:00:57.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502024-12-13T21:00:57.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9512024-12-13T21:00:57.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522024-12-13T21:00:57.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
9532024-12-13T21:00:57.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9542024-12-13T21:00:57.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9552024-12-13T21:00:57.749ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
9562024-12-13T21:00:57.749ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.658864ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
9572024-12-13T21:00:58.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a1c8487-8f42-42eb-befd-297b947f2426 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9582024-12-13T21:00:58.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a1c8487-8f42-42eb-befd-297b947f2426 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9592024-12-13T21:00:58.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a1c8487-8f42-42eb-befd-297b947f2426 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9602024-12-13T21:00:59.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 41193e3d-fdc5-447e-af91-5cf2365ece5d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9612024-12-13T21:00:59.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 41193e3d-fdc5-447e-af91-5cf2365ece5d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9622024-12-13T21:00:59.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 41193e3d-fdc5-447e-af91-5cf2365ece5d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9632024-12-13T21:01:00.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e76c4d4d-c86b-4093-8828-29cd789f4013 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9642024-12-13T21:01:00.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e76c4d4d-c86b-4093-8828-29cd789f4013 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9652024-12-13T21:01:00.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e76c4d4d-c86b-4093-8828-29cd789f4013 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9662024-12-13T21:01:01.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bc10773f-5f8a-461b-820f-89141fd1f6ac roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9672024-12-13T21:01:01.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bc10773f-5f8a-461b-820f-89141fd1f6ac resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9682024-12-13T21:01:01.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bc10773f-5f8a-461b-820f-89141fd1f6ac response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9692024-12-13T21:01:02.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5ac39fd-ff0c-42c0-a051-d8b1c8fc5b6b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9702024-12-13T21:01:02.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5ac39fd-ff0c-42c0-a051-d8b1c8fc5b6b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9712024-12-13T21:01:02.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5ac39fd-ff0c-42c0-a051-d8b1c8fc5b6b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9722024-12-13T21:01:03.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b9e7ff9e-d70f-4da8-a594-42f536cb4d63 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9732024-12-13T21:01:03.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b9e7ff9e-d70f-4da8-a594-42f536cb4d63 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9742024-12-13T21:01:03.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b9e7ff9e-d70f-4da8-a594-42f536cb4d63 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9752024-12-13T21:01:04.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 57f68b67-e66a-4794-b13b-f957951e9040 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9762024-12-13T21:01:04.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 57f68b67-e66a-4794-b13b-f957951e9040 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9772024-12-13T21:01:04.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 57f68b67-e66a-4794-b13b-f957951e9040 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9782024-12-13T21:01:05.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 53380987-fdb3-46d8-84b7-2767b8da27c6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9792024-12-13T21:01:05.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 53380987-fdb3-46d8-84b7-2767b8da27c6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9802024-12-13T21:01:05.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 53380987-fdb3-46d8-84b7-2767b8da27c6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9812024-12-13T21:01:06.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 84140633-5a42-49b1-b49f-208d8065b25e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9822024-12-13T21:01:06.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 84140633-5a42-49b1-b49f-208d8065b25e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9832024-12-13T21:01:06.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 84140633-5a42-49b1-b49f-208d8065b25e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9842024-12-13T21:01:07.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 18c0be66-31aa-415d-a915-5257f1319267 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9852024-12-13T21:01:07.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 18c0be66-31aa-415d-a915-5257f1319267 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9862024-12-13T21:01:07.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 18c0be66-31aa-415d-a915-5257f1319267 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
9872024-12-13T21:01:07.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c9ad17cd-daac-4aa1-bbc9-f27552139a7b response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
9882024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
9892024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
9902024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9912024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
9922024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9932024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9942024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9952024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
9962024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
9972024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
9982024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9992024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
10002024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10012024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10022024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
10032024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
10042024-12-13T21:01:07.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10052024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
10062024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10072024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10082024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10092024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
10102024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
10112024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10122024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10132024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
10142024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10152024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10162024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10172024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10182024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10192024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10202024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10212024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10222024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10232024-12-13T21:01:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10242024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10252024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10262024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10272024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
10282024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10292024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
10302024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10312024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
10322024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10332024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
10342024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10352024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10362024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10372024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10382024-12-13T21:01:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10392024-12-13T21:01:07.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10402024-12-13T21:01:07.728ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10412024-12-13T21:01:07.728ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10422024-12-13T21:01:07.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10432024-12-13T21:01:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10442024-12-13T21:01:07.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.83279ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10452024-12-13T21:01:07.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1109, tv_nsec: 241429526 } })
10462024-12-13T21:01:07.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10472024-12-13T21:01:07.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10482024-12-13T21:01:07.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10492024-12-13T21:01:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10502024-12-13T21:01:07.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10512024-12-13T21:01:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10522024-12-13T21:01:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10532024-12-13T21:01:07.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10542024-12-13T21:01:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10552024-12-13T21:01:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10562024-12-13T21:01:07.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10572024-12-13T21:01:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10582024-12-13T21:01:07.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1109, tv_nsec: 245422320 } })
10592024-12-13T21:01:07.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10602024-12-13T21:01:07.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10612024-12-13T21:01:07.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622024-12-13T21:01:07.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10632024-12-13T21:01:07.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10642024-12-13T21:01:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10652024-12-13T21:01:07.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10662024-12-13T21:01:07.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10672024-12-13T21:01:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10682024-12-13T21:01:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10692024-12-13T21:01:07.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10702024-12-13T21:01:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10712024-12-13T21:01:07.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10722024-12-13T21:01:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10732024-12-13T21:01:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10742024-12-13T21:01:07.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.119681ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
10752024-12-13T21:01:07.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10762024-12-13T21:01:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10772024-12-13T21:01:07.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1109, tv_nsec: 254434933 } })
10782024-12-13T21:01:07.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
10792024-12-13T21:01:07.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802024-12-13T21:01:07.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10812024-12-13T21:01:07.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10822024-12-13T21:01:07.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10832024-12-13T21:01:07.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10842024-12-13T21:01:07.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10852024-12-13T21:01:07.747ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10862024-12-13T21:01:07.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.688808ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10872024-12-13T21:01:07.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10882024-12-13T21:01:07.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10892024-12-13T21:01:07.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902024-12-13T21:01:07.751ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-12-13T21:01:07.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
10922024-12-13T21:01:07.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10932024-12-13T21:01:07.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10942024-12-13T21:01:07.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10952024-12-13T21:01:07.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10962024-12-13T21:01:07.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10972024-12-13T21:01:07.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10982024-12-13T21:01:07.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10992024-12-13T21:01:07.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11002024-12-13T21:01:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11012024-12-13T21:01:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11022024-12-13T21:01:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11032024-12-13T21:01:07.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.269548ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11042024-12-13T21:01:07.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.236742ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
11052024-12-13T21:01:07.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11062024-12-13T21:01:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11072024-12-13T21:01:07.774ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11082024-12-13T21:01:07.774ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11092024-12-13T21:01:07.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11102024-12-13T21:01:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11112024-12-13T21:01:07.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11122024-12-13T21:01:07.809ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11132024-12-13T21:01:07.809ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aa40763-f2be-476a-83a2-1f8680dd4f48", "content-length": "26", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11142024-12-13T21:01:07.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11152024-12-13T21:01:07.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11162024-12-13T21:01:07.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11172024-12-13T21:01:07.818ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11182024-12-13T21:01:07.818ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75d88275-d4b4-418f-9f04-b6f9c773cfde", "content-length": "26", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11192024-12-13T21:01:07.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11202024-12-13T21:01:07.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11212024-12-13T21:01:07.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11222024-12-13T21:01:07.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11232024-12-13T21:01:07.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
11242024-12-13T21:01:07.933ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11252024-12-13T21:01:07.934ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "740e1d1b-fcf4-46b8-a21c-d51f4a89bfc9", "content-length": "26", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11262024-12-13T21:01:07.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11272024-12-13T21:01:07.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
11282024-12-13T21:01:07.959ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11292024-12-13T21:01:07.959ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11302024-12-13T21:01:07.960ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ca03fc-a099-4fcf-9eb4-d3140b2e0fbb", "content-length": "372", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11312024-12-13T21:01:07.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11322024-12-13T21:01:07.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11332024-12-13T21:01:07.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 238.208308ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11342024-12-13T21:01:07.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11352024-12-13T21:01:07.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11362024-12-13T21:01:07.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-12-13T21:01:07.975ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 250.059275ms iteration = 11 status = {"physical_disks_added":0}
11382024-12-13T21:01:07.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
11392024-12-13T21:01:07.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11402024-12-13T21:01:07.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11412024-12-13T21:01:07.977ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 252.54211ms iteration = 8 status = 0
11422024-12-13T21:01:07.984ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
11432024-12-13T21:01:07.984ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 259.357947ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
11442024-12-13T21:01:07.987ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11452024-12-13T21:01:07.987ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11462024-12-13T21:01:07.988ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9170635a-a11c-48e0-af6f-e2fecd1df2d5", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11472024-12-13T21:01:07.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11482024-12-13T21:01:07.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11492024-12-13T21:01:07.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11502024-12-13T21:01:07.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11512024-12-13T21:01:07.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11522024-12-13T21:01:07.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11532024-12-13T21:01:07.998ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11542024-12-13T21:01:07.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11552024-12-13T21:01:07.998ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79e58208-dbc8-45ad-ada6-3b8387cf80f7", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11562024-12-13T21:01:07.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 272.404995ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11572024-12-13T21:01:08.000ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 275.726831ms iteration = 9 status = {}
11582024-12-13T21:01:08.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11592024-12-13T21:01:08.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11602024-12-13T21:01:08.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 277.95446ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11612024-12-13T21:01:08.005ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11622024-12-13T21:01:08.005ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11632024-12-13T21:01:08.005ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 280.255129ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11642024-12-13T21:01:08.029ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 303.914843ms iteration = 8 status = {}
11652024-12-13T21:01:08.030ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11662024-12-13T21:01:08.030ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2fad3f2-3f56-449b-bc94-bb19fecaeec7", "content-length": "1", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11672024-12-13T21:01:08.032ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11682024-12-13T21:01:08.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11692024-12-13T21:01:08.034ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 309.553789ms iteration = 8 status = null
11702024-12-13T21:01:08.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11712024-12-13T21:01:08.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11722024-12-13T21:01:08.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11732024-12-13T21:01:08.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11742024-12-13T21:01:08.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11752024-12-13T21:01:08.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11762024-12-13T21:01:08.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11772024-12-13T21:01:08.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11782024-12-13T21:01:08.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11792024-12-13T21:01:08.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11802024-12-13T21:01:08.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11812024-12-13T21:01:08.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11822024-12-13T21:01:08.099ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
11832024-12-13T21:01:08.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11842024-12-13T21:01:08.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11852024-12-13T21:01:08.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11862024-12-13T21:01:08.110ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "684cc450-0721-42ff-9292-0281b7eb95fa", "content-length": "134", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
11872024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11882024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
11892024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11902024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11912024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11922024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11932024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11942024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11952024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11962024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11972024-12-13T21:01:08.110ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
11982024-12-13T21:01:08.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11992024-12-13T21:01:08.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12002024-12-13T21:01:08.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12012024-12-13T21:01:08.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e6e70b5-acaf-434f-ad39-b71a0f626a33", "content-length": "2", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
12022024-12-13T21:01:08.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12032024-12-13T21:01:08.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e2c199a-8879-4031-9496-626a7e109084", "content-length": "52", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
12042024-12-13T21:01:08.115ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
12052024-12-13T21:01:08.115ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12062024-12-13T21:01:08.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12072024-12-13T21:01:08.208ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "02bf6512-7621-4f12-9061-cf3ae34528b9", "date": "Fri, 13 Dec 2024 21:01:07 GMT"} })
12082024-12-13T21:01:08.208ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
12092024-12-13T21:01:08.208ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12102024-12-13T21:01:08.209ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "674fa34d-26b5-44e3-b96d-9189d5ce3700", "content-length": "682", "date": "Fri, 13 Dec 2024 21:01:08 GMT"} })
12112024-12-13T21:01:08.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12122024-12-13T21:01:08.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12132024-12-13T21:01:08.209ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a991098-e6e1-4613-abd1-b7c619c63cb6", "content-length": "691", "date": "Fri, 13 Dec 2024 21:01:08 GMT"} })
12142024-12-13T21:01:08.209ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12152024-12-13T21:01:08.209ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12162024-12-13T21:01:08.209ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12172024-12-13T21:01:08.210ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 485.189695ms iteration = 8 status = {}
12182024-12-13T21:01:08.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12192024-12-13T21:01:08.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12202024-12-13T21:01:08.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12212024-12-13T21:01:08.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12222024-12-13T21:01:08.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12232024-12-13T21:01:08.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12242024-12-13T21:01:08.226ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.716294ms iteration = 8 status = {}
12252024-12-13T21:01:08.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 50ac1c76-28d0-45e8-b92f-1e0185ee889f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12262024-12-13T21:01:08.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 50ac1c76-28d0-45e8-b92f-1e0185ee889f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12272024-12-13T21:01:08.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 50ac1c76-28d0-45e8-b92f-1e0185ee889f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12282024-12-13T21:01:09.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 960275e7-9c8a-4b44-be37-4f2b1deb52a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12292024-12-13T21:01:09.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 960275e7-9c8a-4b44-be37-4f2b1deb52a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12302024-12-13T21:01:09.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 960275e7-9c8a-4b44-be37-4f2b1deb52a6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12312024-12-13T21:01:09.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 74f434e6-7f41-4170-a90a-d15481c2513c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12322024-12-13T21:01:09.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 74f434e6-7f41-4170-a90a-d15481c2513c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12332024-12-13T21:01:09.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 74f434e6-7f41-4170-a90a-d15481c2513c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12342024-12-13T21:01:10.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d7dbf07-8794-4136-a4f0-84114cbec70d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12352024-12-13T21:01:10.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d7dbf07-8794-4136-a4f0-84114cbec70d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12362024-12-13T21:01:10.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d7dbf07-8794-4136-a4f0-84114cbec70d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12372024-12-13T21:01:11.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 39f38585-11a4-44e5-8357-81527d4bbd23 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12382024-12-13T21:01:11.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 39f38585-11a4-44e5-8357-81527d4bbd23 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12392024-12-13T21:01:11.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 39f38585-11a4-44e5-8357-81527d4bbd23 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12402024-12-13T21:01:12.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d34601e-0784-4e76-99df-6c134211aaa4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12412024-12-13T21:01:12.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d34601e-0784-4e76-99df-6c134211aaa4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12422024-12-13T21:01:12.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d34601e-0784-4e76-99df-6c134211aaa4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12432024-12-13T21:01:13.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b031f2d0-0e32-4b37-8174-7d614fbe69c7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12442024-12-13T21:01:13.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b031f2d0-0e32-4b37-8174-7d614fbe69c7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12452024-12-13T21:01:13.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b031f2d0-0e32-4b37-8174-7d614fbe69c7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12462024-12-13T21:01:14.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5ac72eb3-de27-4458-892a-aa6042c8d9ca roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12472024-12-13T21:01:14.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5ac72eb3-de27-4458-892a-aa6042c8d9ca resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12482024-12-13T21:01:14.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5ac72eb3-de27-4458-892a-aa6042c8d9ca response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12492024-12-13T21:01:15.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5c41d6ac-711c-496e-b064-6d4894a94394 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12502024-12-13T21:01:15.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5c41d6ac-711c-496e-b064-6d4894a94394 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12512024-12-13T21:01:15.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5c41d6ac-711c-496e-b064-6d4894a94394 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12522024-12-13T21:01:16.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c44535a2-daff-4573-aa6d-cc35adb637ad roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12532024-12-13T21:01:16.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c44535a2-daff-4573-aa6d-cc35adb637ad resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12542024-12-13T21:01:16.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c44535a2-daff-4573-aa6d-cc35adb637ad response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12552024-12-13T21:01:17.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1312 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 1cd12799-1275-4ee0-960c-1440e2eeebb1 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
12562024-12-13T21:01:17.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
12572024-12-13T21:01:17.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
12582024-12-13T21:01:17.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12592024-12-13T21:01:17.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12602024-12-13T21:01:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12612024-12-13T21:01:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12622024-12-13T21:01:17.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12632024-12-13T21:01:17.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12642024-12-13T21:01:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12652024-12-13T21:01:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12662024-12-13T21:01:17.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12672024-12-13T21:01:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12682024-12-13T21:01:17.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12692024-12-13T21:01:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12702024-12-13T21:01:17.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712024-12-13T21:01:17.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
12722024-12-13T21:01:17.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12732024-12-13T21:01:17.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12742024-12-13T21:01:17.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
12752024-12-13T21:01:17.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.734983ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
12762024-12-13T21:01:17.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.089396ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12772024-12-13T21:01:17.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 994097ef-8be8-47c6-8969-331ac2bac074 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12782024-12-13T21:01:17.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 994097ef-8be8-47c6-8969-331ac2bac074 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12792024-12-13T21:01:17.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 994097ef-8be8-47c6-8969-331ac2bac074 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12802024-12-13T21:01:18.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0547631d-2d87-4a67-bf19-647587ec297c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12812024-12-13T21:01:18.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0547631d-2d87-4a67-bf19-647587ec297c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12822024-12-13T21:01:18.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0547631d-2d87-4a67-bf19-647587ec297c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12832024-12-13T21:01:19.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cec35be5-bcf3-4ccd-a895-b3de4beb0f5b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12842024-12-13T21:01:19.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cec35be5-bcf3-4ccd-a895-b3de4beb0f5b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12852024-12-13T21:01:19.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cec35be5-bcf3-4ccd-a895-b3de4beb0f5b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12862024-12-13T21:01:20.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1a8b740a-c5bb-4743-b0b8-447143b5e263 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12872024-12-13T21:01:20.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1a8b740a-c5bb-4743-b0b8-447143b5e263 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12882024-12-13T21:01:20.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1a8b740a-c5bb-4743-b0b8-447143b5e263 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12892024-12-13T21:01:21.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6b1f52ca-39d1-4c3a-893f-fe933fb6f2a9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12902024-12-13T21:01:21.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6b1f52ca-39d1-4c3a-893f-fe933fb6f2a9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12912024-12-13T21:01:21.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6b1f52ca-39d1-4c3a-893f-fe933fb6f2a9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12922024-12-13T21:01:22.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7e59053-f577-4b5d-af72-1a3358cf79a9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12932024-12-13T21:01:22.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7e59053-f577-4b5d-af72-1a3358cf79a9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12942024-12-13T21:01:22.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7e59053-f577-4b5d-af72-1a3358cf79a9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12952024-12-13T21:01:23.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dc3ce4fa-bfd0-4135-b672-08a6c960bdb6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12962024-12-13T21:01:23.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dc3ce4fa-bfd0-4135-b672-08a6c960bdb6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12972024-12-13T21:01:23.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dc3ce4fa-bfd0-4135-b672-08a6c960bdb6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12982024-12-13T21:01:24.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 611cf5ea-1776-488d-9814-bf9af1065fd9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
12992024-12-13T21:01:24.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 611cf5ea-1776-488d-9814-bf9af1065fd9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13002024-12-13T21:01:24.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 611cf5ea-1776-488d-9814-bf9af1065fd9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13012024-12-13T21:01:25.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6220d88a-bd74-4a6a-9f2d-634be0dcc467 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13022024-12-13T21:01:25.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6220d88a-bd74-4a6a-9f2d-634be0dcc467 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13032024-12-13T21:01:25.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6220d88a-bd74-4a6a-9f2d-634be0dcc467 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13042024-12-13T21:01:26.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3c90afdc-33fb-4b5b-bb63-76cb75d44ab8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13052024-12-13T21:01:26.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3c90afdc-33fb-4b5b-bb63-76cb75d44ab8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13062024-12-13T21:01:26.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3c90afdc-33fb-4b5b-bb63-76cb75d44ab8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13072024-12-13T21:01:27.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d36354b6-80bf-4905-87bc-2852db846b67 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
13082024-12-13T21:01:27.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
13092024-12-13T21:01:27.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13102024-12-13T21:01:27.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
13112024-12-13T21:01:27.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13122024-12-13T21:01:27.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13132024-12-13T21:01:27.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13142024-12-13T21:01:27.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13152024-12-13T21:01:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13162024-12-13T21:01:27.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172024-12-13T21:01:27.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.984793ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13182024-12-13T21:01:27.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13192024-12-13T21:01:27.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13202024-12-13T21:01:27.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13212024-12-13T21:01:27.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13222024-12-13T21:01:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13232024-12-13T21:01:27.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13242024-12-13T21:01:27.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
13252024-12-13T21:01:27.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13262024-12-13T21:01:27.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13272024-12-13T21:01:27.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
13282024-12-13T21:01:27.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.879626ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
13292024-12-13T21:01:28.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f10446bd-3087-4666-9cf1-7316535d03ab roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13302024-12-13T21:01:28.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f10446bd-3087-4666-9cf1-7316535d03ab resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13312024-12-13T21:01:28.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f10446bd-3087-4666-9cf1-7316535d03ab response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13322024-12-13T21:01:29.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6f7a50e1-15fa-4a11-a324-17e862dd36df roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13332024-12-13T21:01:29.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6f7a50e1-15fa-4a11-a324-17e862dd36df resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13342024-12-13T21:01:29.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6f7a50e1-15fa-4a11-a324-17e862dd36df response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13352024-12-13T21:01:30.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4f878524-c204-4426-b190-b21bec2a92c9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13362024-12-13T21:01:30.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4f878524-c204-4426-b190-b21bec2a92c9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13372024-12-13T21:01:30.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4f878524-c204-4426-b190-b21bec2a92c9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13382024-12-13T21:01:31.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 38c5c012-5b46-4eae-a23f-ffa080bd7256 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13392024-12-13T21:01:31.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 38c5c012-5b46-4eae-a23f-ffa080bd7256 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13402024-12-13T21:01:31.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 38c5c012-5b46-4eae-a23f-ffa080bd7256 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13412024-12-13T21:01:32.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 110377d3-0860-4eae-b619-ac9ef9bb5d06 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13422024-12-13T21:01:32.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 110377d3-0860-4eae-b619-ac9ef9bb5d06 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13432024-12-13T21:01:32.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 110377d3-0860-4eae-b619-ac9ef9bb5d06 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13442024-12-13T21:01:32.635ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:60119
13452024-12-13T21:01:32.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = f29eda62-fe72-4ef3-82c2-78cbe76f22c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
13462024-12-13T21:01:32.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = f29eda62-fe72-4ef3-82c2-78cbe76f22c7 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
13472024-12-13T21:01:32.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = f29eda62-fe72-4ef3-82c2-78cbe76f22c7 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
13482024-12-13T21:01:32.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 43470638-3ef8-4305-b9f6-526af851b95c roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
13492024-12-13T21:01:32.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 43470638-3ef8-4305-b9f6-526af851b95c resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
13502024-12-13T21:01:32.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 43470638-3ef8-4305-b9f6-526af851b95c response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
13512024-12-13T21:01:33.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a5fec326-03d2-40d1-b216-b47999758096 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13522024-12-13T21:01:33.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a5fec326-03d2-40d1-b216-b47999758096 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13532024-12-13T21:01:33.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a5fec326-03d2-40d1-b216-b47999758096 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13542024-12-13T21:01:34.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 566d93bf-dcfd-4eba-917e-8c9a9722af62 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13552024-12-13T21:01:34.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 566d93bf-dcfd-4eba-917e-8c9a9722af62 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13562024-12-13T21:01:34.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 566d93bf-dcfd-4eba-917e-8c9a9722af62 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13572024-12-13T21:01:35.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = adc828e5-7306-49bf-ad1b-f94a28f8a810 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13582024-12-13T21:01:35.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = adc828e5-7306-49bf-ad1b-f94a28f8a810 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13592024-12-13T21:01:35.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = adc828e5-7306-49bf-ad1b-f94a28f8a810 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13602024-12-13T21:01:36.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 489a93e1-39e9-4aaa-8370-782446b4ef94 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13612024-12-13T21:01:36.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 489a93e1-39e9-4aaa-8370-782446b4ef94 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13622024-12-13T21:01:36.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 489a93e1-39e9-4aaa-8370-782446b4ef94 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13632024-12-13T21:01:37.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e90fc20a-81a2-4d24-a496-cbf5de13c598 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13642024-12-13T21:01:37.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e90fc20a-81a2-4d24-a496-cbf5de13c598 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13652024-12-13T21:01:37.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e90fc20a-81a2-4d24-a496-cbf5de13c598 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
13662024-12-13T21:01:37.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 9952d588-330b-41dc-b33f-1c8f39fc5fcd response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
13672024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
13682024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13692024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
13702024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13712024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
13722024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
13732024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13742024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
13752024-12-13T21:01:37.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13762024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
13772024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13782024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13792024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13802024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
13812024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13822024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
13832024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
13842024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
13852024-12-13T21:01:37.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13862024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13872024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13882024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
13892024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13902024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13912024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
13922024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
13932024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13942024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
13952024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
13962024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13972024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13982024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13992024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
14002024-12-13T21:01:37.725ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
14012024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.351\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
14022024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
14032024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
14042024-12-13T21:01:37.725ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:51:37.725228211 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14052024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
14062024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14072024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14082024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
14092024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
14102024-12-13T21:01:37.725ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14112024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
14122024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14132024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
14142024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14152024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
14162024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14172024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14182024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14192024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14202024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14212024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14222024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14232024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14242024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14252024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14262024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14272024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
14282024-12-13T21:01:37.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
14292024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14302024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14312024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14322024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14332024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14342024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14352024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14362024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
14372024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
14382024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
14392024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
14402024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14412024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14422024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14432024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14442024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14452024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14462024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14472024-12-13T21:01:37.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 238360310 } })
14482024-12-13T21:01:37.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 238401091 } })
14492024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14502024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14512024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14522024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14532024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14542024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14552024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14562024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.299864ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14572024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14582024-12-13T21:01:37.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.395846ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14592024-12-13T21:01:37.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602024-12-13T21:01:37.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612024-12-13T21:01:37.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622024-12-13T21:01:37.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14632024-12-13T21:01:37.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.744223ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14642024-12-13T21:01:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14652024-12-13T21:01:37.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14662024-12-13T21:01:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14672024-12-13T21:01:37.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14682024-12-13T21:01:37.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14692024-12-13T21:01:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14702024-12-13T21:01:37.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14712024-12-13T21:01:37.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14722024-12-13T21:01:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14732024-12-13T21:01:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14742024-12-13T21:01:37.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14752024-12-13T21:01:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14762024-12-13T21:01:37.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 245327081 } })
14772024-12-13T21:01:37.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14782024-12-13T21:01:37.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14792024-12-13T21:01:37.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14802024-12-13T21:01:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14812024-12-13T21:01:37.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822024-12-13T21:01:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14832024-12-13T21:01:37.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14842024-12-13T21:01:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14852024-12-13T21:01:37.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14862024-12-13T21:01:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14872024-12-13T21:01:37.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14882024-12-13T21:01:37.738ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14892024-12-13T21:01:37.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 251693556 } })
14902024-12-13T21:01:37.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14912024-12-13T21:01:37.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14922024-12-13T21:01:37.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14932024-12-13T21:01:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14942024-12-13T21:01:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14952024-12-13T21:01:37.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14962024-12-13T21:01:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14972024-12-13T21:01:37.743ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:51:37.725228211 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14982024-12-13T21:01:37.743ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.829783ms iteration = 5 status = {"expiration":"2024-12-13T20:51:37.725228211Z","pruned":[]}
14992024-12-13T21:01:37.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15002024-12-13T21:01:37.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15012024-12-13T21:01:37.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15022024-12-13T21:01:37.744ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.385097ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
15032024-12-13T21:01:37.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042024-12-13T21:01:37.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15052024-12-13T21:01:37.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15062024-12-13T21:01:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15072024-12-13T21:01:37.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15082024-12-13T21:01:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15092024-12-13T21:01:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15102024-12-13T21:01:37.749ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15112024-12-13T21:01:37.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15122024-12-13T21:01:37.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15132024-12-13T21:01:37.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15142024-12-13T21:01:37.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15152024-12-13T21:01:37.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15162024-12-13T21:01:37.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 267195888 } })
15172024-12-13T21:01:37.755ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
15182024-12-13T21:01:37.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15192024-12-13T21:01:37.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15202024-12-13T21:01:37.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15212024-12-13T21:01:37.761ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15222024-12-13T21:01:37.761ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15232024-12-13T21:01:37.761ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15242024-12-13T21:01:37.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15252024-12-13T21:01:37.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15262024-12-13T21:01:37.764ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15272024-12-13T21:01:37.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 39.268278ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15282024-12-13T21:01:37.766ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15292024-12-13T21:01:37.766ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15302024-12-13T21:01:37.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15312024-12-13T21:01:37.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322024-12-13T21:01:37.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15332024-12-13T21:01:37.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
15342024-12-13T21:01:37.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15352024-12-13T21:01:37.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15362024-12-13T21:01:37.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15372024-12-13T21:01:37.772ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15382024-12-13T21:01:37.772ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15392024-12-13T21:01:37.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15402024-12-13T21:01:37.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15412024-12-13T21:01:37.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15422024-12-13T21:01:37.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15432024-12-13T21:01:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15442024-12-13T21:01:37.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15452024-12-13T21:01:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15462024-12-13T21:01:37.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.621107ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15472024-12-13T21:01:37.779ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15482024-12-13T21:01:37.779ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15492024-12-13T21:01:37.779ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 54.935654ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15502024-12-13T21:01:37.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.597993ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
15512024-12-13T21:01:37.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.529852ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
15522024-12-13T21:01:37.790ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15532024-12-13T21:01:37.790ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15542024-12-13T21:01:37.790ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.137483ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15552024-12-13T21:01:37.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15562024-12-13T21:01:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15572024-12-13T21:01:37.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15582024-12-13T21:01:37.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15592024-12-13T21:01:37.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15602024-12-13T21:01:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15612024-12-13T21:01:37.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-12-13T21:01:37.794ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
15632024-12-13T21:01:37.794ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.437321ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
15642024-12-13T21:01:37.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15652024-12-13T21:01:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15662024-12-13T21:01:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15672024-12-13T21:01:37.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15682024-12-13T21:01:37.796ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15692024-12-13T21:01:37.796ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15702024-12-13T21:01:37.796ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.477914ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15712024-12-13T21:01:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15722024-12-13T21:01:37.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15732024-12-13T21:01:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15742024-12-13T21:01:37.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15752024-12-13T21:01:37.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15762024-12-13T21:01:37.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.787635ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15772024-12-13T21:01:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
15782024-12-13T21:01:37.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15792024-12-13T21:01:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15802024-12-13T21:01:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15812024-12-13T21:01:37.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15822024-12-13T21:01:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.014796ms iteration = 9 status = 0
15832024-12-13T21:01:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15842024-12-13T21:01:37.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15852024-12-13T21:01:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15862024-12-13T21:01:37.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15872024-12-13T21:01:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15882024-12-13T21:01:37.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15892024-12-13T21:01:37.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15902024-12-13T21:01:37.828ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15912024-12-13T21:01:37.828ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15922024-12-13T21:01:37.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15932024-12-13T21:01:37.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15942024-12-13T21:01:37.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.86148ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15952024-12-13T21:01:37.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15962024-12-13T21:01:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15972024-12-13T21:01:37.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15982024-12-13T21:01:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15992024-12-13T21:01:37.838ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16002024-12-13T21:01:37.838ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16012024-12-13T21:01:37.838ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
16022024-12-13T21:01:37.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 113.314659ms iteration = 6 status = {"generation":1}
16032024-12-13T21:01:37.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.146887ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16042024-12-13T21:01:37.840ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16052024-12-13T21:01:37.844ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16062024-12-13T21:01:37.844ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16072024-12-13T21:01:37.844ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16082024-12-13T21:01:37.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16092024-12-13T21:01:37.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16102024-12-13T21:01:37.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16112024-12-13T21:01:37.846ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16122024-12-13T21:01:37.846ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16132024-12-13T21:01:37.846ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.891522ms iteration = 12 status = {"physical_disks_added":0}
16142024-12-13T21:01:37.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16152024-12-13T21:01:37.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16162024-12-13T21:01:37.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16172024-12-13T21:01:37.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16182024-12-13T21:01:37.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16192024-12-13T21:01:37.865ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16202024-12-13T21:01:37.866ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35a5a2ec-9804-4db1-8169-c98a91a27d0a", "content-length": "26", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16212024-12-13T21:01:37.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16222024-12-13T21:01:37.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16232024-12-13T21:01:37.881ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16242024-12-13T21:01:37.881ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16252024-12-13T21:01:37.881ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2beacc9e-969d-4413-8a47-c6a2b26cc89b", "content-length": "26", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16262024-12-13T21:01:37.881ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16272024-12-13T21:01:37.884ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16282024-12-13T21:01:37.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
16292024-12-13T21:01:37.902ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16302024-12-13T21:01:37.902ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f64632-864e-4a8c-aa45-b4afb505495d", "content-length": "26", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16312024-12-13T21:01:37.902ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16322024-12-13T21:01:37.904ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
16332024-12-13T21:01:37.939ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16342024-12-13T21:01:37.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.216616ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16352024-12-13T21:01:37.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16362024-12-13T21:01:37.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16372024-12-13T21:01:37.991ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16382024-12-13T21:01:37.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16392024-12-13T21:01:37.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d96d7105-cbbd-417a-a328-138430dfa1dd", "content-length": "372", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16402024-12-13T21:01:37.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16412024-12-13T21:01:37.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16422024-12-13T21:01:37.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16432024-12-13T21:01:37.995ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16442024-12-13T21:01:37.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452024-12-13T21:01:37.995ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6c196758-575b-486e-8524-8a7d47cb5b02", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16462024-12-13T21:01:37.995ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16472024-12-13T21:01:37.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16482024-12-13T21:01:37.996ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16492024-12-13T21:01:37.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16502024-12-13T21:01:37.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a516306a-cb1c-4a74-86b4-855af0becf9d", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16512024-12-13T21:01:37.997ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16522024-12-13T21:01:37.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16532024-12-13T21:01:37.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16542024-12-13T21:01:37.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16552024-12-13T21:01:37.998ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16562024-12-13T21:01:37.998ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 273.7234ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16572024-12-13T21:01:38.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16582024-12-13T21:01:38.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16592024-12-13T21:01:38.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16602024-12-13T21:01:38.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16612024-12-13T21:01:38.035ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.801692ms iteration = 9 status = {}
16622024-12-13T21:01:38.036ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16632024-12-13T21:01:38.036ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
16642024-12-13T21:01:38.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16652024-12-13T21:01:38.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16662024-12-13T21:01:38.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16672024-12-13T21:01:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16682024-12-13T21:01:38.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16692024-12-13T21:01:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16702024-12-13T21:01:38.046ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
16712024-12-13T21:01:38.046ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 321.531659ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16722024-12-13T21:01:38.052ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16732024-12-13T21:01:38.052ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6c8a3df-07bd-4285-b933-45e8b59b2856", "content-length": "1", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16742024-12-13T21:01:38.054ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16752024-12-13T21:01:38.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16762024-12-13T21:01:38.063ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16772024-12-13T21:01:38.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16782024-12-13T21:01:38.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "62a2f215-268a-4b11-af9c-c8b7aa620932", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16792024-12-13T21:01:38.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16802024-12-13T21:01:38.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16812024-12-13T21:01:38.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16822024-12-13T21:01:38.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fe4828f5-551b-43c1-95f0-b11b31383e1b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
16832024-12-13T21:01:38.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fe4828f5-551b-43c1-95f0-b11b31383e1b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
16842024-12-13T21:01:38.323ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16852024-12-13T21:01:38.324ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9d1aba0-3ad4-44d8-a5c8-dec0372069e7", "content-length": "691", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
16862024-12-13T21:01:38.324ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16872024-12-13T21:01:38.324ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16882024-12-13T21:01:38.324ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16892024-12-13T21:01:38.325ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 600.600108ms iteration = 9 status = {}
16902024-12-13T21:01:38.326ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
16912024-12-13T21:01:38.326ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16922024-12-13T21:01:38.326ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
16932024-12-13T21:01:38.326ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 600.932506ms iteration = 6 status = {"generation":2}
16942024-12-13T21:01:38.326ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 601.321336ms iteration = 9 status = null
16952024-12-13T21:01:38.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fe4828f5-551b-43c1-95f0-b11b31383e1b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
16962024-12-13T21:01:38.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16972024-12-13T21:01:38.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16982024-12-13T21:01:38.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16992024-12-13T21:01:38.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17002024-12-13T21:01:38.333ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17012024-12-13T21:01:38.333ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17022024-12-13T21:01:38.334ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e96ca93-3995-4775-b66d-958471856352", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
17032024-12-13T21:01:38.336ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 611.097599ms iteration = 10 status = {}
17042024-12-13T21:01:38.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17052024-12-13T21:01:38.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "173d6923-56a5-4214-8698-a2779f45ed90", "date": "Fri, 13 Dec 2024 21:01:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17062024-12-13T21:01:38.343ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17072024-12-13T21:01:38.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "329e9336-c6bd-41c8-897b-61033cd7558c", "date": "Fri, 13 Dec 2024 21:01:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17082024-12-13T21:01:38.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17092024-12-13T21:01:38.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "77f9b1d7-70e9-4c27-9369-b79099de495a", "date": "Fri, 13 Dec 2024 21:01:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17102024-12-13T21:01:38.346ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17112024-12-13T21:01:38.348ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17122024-12-13T21:01:38.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 623.637024ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17132024-12-13T21:01:38.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17142024-12-13T21:01:38.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17152024-12-13T21:01:38.389ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
17162024-12-13T21:01:38.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17172024-12-13T21:01:38.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17182024-12-13T21:01:38.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17192024-12-13T21:01:38.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e05d7d5-8b7b-4ebc-b60a-a00267d7365a", "content-length": "134", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
17202024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17212024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
17222024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17232024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17242024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17252024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17262024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17272024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17282024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17292024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17302024-12-13T21:01:38.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
17312024-12-13T21:01:38.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17322024-12-13T21:01:38.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17332024-12-13T21:01:38.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17342024-12-13T21:01:38.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8423edf-fb45-4353-a0b2-e16c55800ca5", "content-length": "2", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
17352024-12-13T21:01:38.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17362024-12-13T21:01:38.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7c19cfd-cbd7-4937-b687-35621264feb0", "content-length": "52", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
17372024-12-13T21:01:38.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
17382024-12-13T21:01:38.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17392024-12-13T21:01:38.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "50806b3a-5d31-4a0a-901b-0a43dc998f89", "date": "Fri, 13 Dec 2024 21:01:37 GMT"} })
17402024-12-13T21:01:38.569ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
17412024-12-13T21:01:38.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17422024-12-13T21:01:38.570ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef803af0-59c1-45de-9e98-98ab719ebb22", "content-length": "682", "date": "Fri, 13 Dec 2024 21:01:38 GMT"} })
17432024-12-13T21:01:38.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17442024-12-13T21:01:38.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17452024-12-13T21:01:38.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17462024-12-13T21:01:38.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17472024-12-13T21:01:38.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17482024-12-13T21:01:38.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17492024-12-13T21:01:38.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17502024-12-13T21:01:38.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17512024-12-13T21:01:38.586ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 861.561626ms iteration = 9 status = {}
17522024-12-13T21:01:39.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = f86ab377-6b48-4f2c-b9ab-56695f2cfb52 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17532024-12-13T21:01:39.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = f86ab377-6b48-4f2c-b9ab-56695f2cfb52 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17542024-12-13T21:01:39.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = f86ab377-6b48-4f2c-b9ab-56695f2cfb52 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17552024-12-13T21:01:39.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c306c9dd-c84c-4678-af42-80f95e77b2ac roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17562024-12-13T21:01:39.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c306c9dd-c84c-4678-af42-80f95e77b2ac resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17572024-12-13T21:01:39.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c306c9dd-c84c-4678-af42-80f95e77b2ac response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17582024-12-13T21:01:40.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 90c7240d-03d8-49ff-a58a-410e42478554 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17592024-12-13T21:01:40.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 90c7240d-03d8-49ff-a58a-410e42478554 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17602024-12-13T21:01:40.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 90c7240d-03d8-49ff-a58a-410e42478554 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17612024-12-13T21:01:41.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 17bc0c68-e8e8-4f55-a82a-0667b4e84a6c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17622024-12-13T21:01:41.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 17bc0c68-e8e8-4f55-a82a-0667b4e84a6c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17632024-12-13T21:01:41.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 17bc0c68-e8e8-4f55-a82a-0667b4e84a6c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17642024-12-13T21:01:42.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e2e9a00d-8ebf-46ca-a5b9-4f4a9e587431 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17652024-12-13T21:01:42.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e2e9a00d-8ebf-46ca-a5b9-4f4a9e587431 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17662024-12-13T21:01:42.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e2e9a00d-8ebf-46ca-a5b9-4f4a9e587431 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17672024-12-13T21:01:43.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = afc922e7-7bdc-4589-9a47-97edaa10566e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17682024-12-13T21:01:43.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = afc922e7-7bdc-4589-9a47-97edaa10566e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17692024-12-13T21:01:43.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = afc922e7-7bdc-4589-9a47-97edaa10566e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17702024-12-13T21:01:44.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02308a2c-69f5-4ba3-9bdb-8a5faa553628 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17712024-12-13T21:01:44.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02308a2c-69f5-4ba3-9bdb-8a5faa553628 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17722024-12-13T21:01:44.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02308a2c-69f5-4ba3-9bdb-8a5faa553628 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17732024-12-13T21:01:45.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 698215b1-3214-420b-8878-3c07baefdf45 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17742024-12-13T21:01:45.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 698215b1-3214-420b-8878-3c07baefdf45 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17752024-12-13T21:01:45.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 698215b1-3214-420b-8878-3c07baefdf45 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17762024-12-13T21:01:46.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d637a75d-41c0-4cfe-b939-a5376cb86233 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17772024-12-13T21:01:46.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d637a75d-41c0-4cfe-b939-a5376cb86233 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17782024-12-13T21:01:46.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d637a75d-41c0-4cfe-b939-a5376cb86233 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17792024-12-13T21:01:47.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bbb1245b-9260-4541-a6d9-53f24519566e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17802024-12-13T21:01:47.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bbb1245b-9260-4541-a6d9-53f24519566e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17812024-12-13T21:01:47.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bbb1245b-9260-4541-a6d9-53f24519566e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
17822024-12-13T21:01:47.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 734988a4-ba08-48b1-be91-2e0455d770db roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
17832024-12-13T21:01:47.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 734988a4-ba08-48b1-be91-2e0455d770db resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
17842024-12-13T21:01:47.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 734988a4-ba08-48b1-be91-2e0455d770db response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
17852024-12-13T21:01:47.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 4820f70b-66b5-4dc0-b3ba-6ad146e7d27b roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
17862024-12-13T21:01:47.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 4820f70b-66b5-4dc0-b3ba-6ad146e7d27b resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
17872024-12-13T21:01:47.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 4820f70b-66b5-4dc0-b3ba-6ad146e7d27b response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
17882024-12-13T21:01:47.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 400eafb7-bfd9-4640-a147-0a6ac4dfd08b response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
17892024-12-13T21:01:47.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
17902024-12-13T21:01:47.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17912024-12-13T21:01:47.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
17922024-12-13T21:01:47.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17932024-12-13T21:01:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17942024-12-13T21:01:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17952024-12-13T21:01:47.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962024-12-13T21:01:47.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17972024-12-13T21:01:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17982024-12-13T21:01:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17992024-12-13T21:01:47.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18002024-12-13T21:01:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18012024-12-13T21:01:47.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18022024-12-13T21:01:47.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18032024-12-13T21:01:47.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18042024-12-13T21:01:47.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
18052024-12-13T21:01:47.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18062024-12-13T21:01:47.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18072024-12-13T21:01:47.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
18082024-12-13T21:01:47.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.241353ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
18092024-12-13T21:01:47.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.584553ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18102024-12-13T21:01:48.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3cff3ee3-8523-4ce0-8a14-599db5cffbff roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18112024-12-13T21:01:48.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3cff3ee3-8523-4ce0-8a14-599db5cffbff resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18122024-12-13T21:01:48.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3cff3ee3-8523-4ce0-8a14-599db5cffbff response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18132024-12-13T21:01:49.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 54b18cbb-e062-45b7-a005-1cfa170536b5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18142024-12-13T21:01:49.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 54b18cbb-e062-45b7-a005-1cfa170536b5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18152024-12-13T21:01:49.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 54b18cbb-e062-45b7-a005-1cfa170536b5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18162024-12-13T21:01:50.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 90c6b513-3e96-4a59-8cf3-70ac7ae3966e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18172024-12-13T21:01:50.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 90c6b513-3e96-4a59-8cf3-70ac7ae3966e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18182024-12-13T21:01:50.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 90c6b513-3e96-4a59-8cf3-70ac7ae3966e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18192024-12-13T21:01:51.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9501527d-febb-4e04-867e-e7b4f70e74e5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18202024-12-13T21:01:51.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9501527d-febb-4e04-867e-e7b4f70e74e5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18212024-12-13T21:01:51.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9501527d-febb-4e04-867e-e7b4f70e74e5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18222024-12-13T21:01:52.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dfffb2f0-9157-45b8-97f4-a4815b3a1b85 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18232024-12-13T21:01:52.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dfffb2f0-9157-45b8-97f4-a4815b3a1b85 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18242024-12-13T21:01:52.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dfffb2f0-9157-45b8-97f4-a4815b3a1b85 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18252024-12-13T21:01:53.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fa7e3d45-4abf-4a7e-af9a-1846fdad8009 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18262024-12-13T21:01:53.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fa7e3d45-4abf-4a7e-af9a-1846fdad8009 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18272024-12-13T21:01:53.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fa7e3d45-4abf-4a7e-af9a-1846fdad8009 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18282024-12-13T21:01:54.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 12275761-3d6e-4565-a895-d499fd6b6e93 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18292024-12-13T21:01:54.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 12275761-3d6e-4565-a895-d499fd6b6e93 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18302024-12-13T21:01:54.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 12275761-3d6e-4565-a895-d499fd6b6e93 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18312024-12-13T21:01:55.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7a03e3a6-e4a2-4517-874e-095261708f78 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18322024-12-13T21:01:55.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7a03e3a6-e4a2-4517-874e-095261708f78 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18332024-12-13T21:01:55.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7a03e3a6-e4a2-4517-874e-095261708f78 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18342024-12-13T21:01:56.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f0e173a-b7ee-44e0-b526-00d520bee8fc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18352024-12-13T21:01:56.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f0e173a-b7ee-44e0-b526-00d520bee8fc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18362024-12-13T21:01:56.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f0e173a-b7ee-44e0-b526-00d520bee8fc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18372024-12-13T21:01:57.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1486 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 78882a30-f6b2-474e-b7af-e2f214735417 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
18382024-12-13T21:01:57.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
18392024-12-13T21:01:57.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
18402024-12-13T21:01:57.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18412024-12-13T21:01:57.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18422024-12-13T21:01:57.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18432024-12-13T21:01:57.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18442024-12-13T21:01:57.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18452024-12-13T21:01:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18462024-12-13T21:01:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18472024-12-13T21:01:57.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.62612ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18482024-12-13T21:01:57.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18492024-12-13T21:01:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18502024-12-13T21:01:57.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18512024-12-13T21:01:57.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18522024-12-13T21:01:57.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18532024-12-13T21:01:57.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18542024-12-13T21:01:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
18552024-12-13T21:01:57.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18562024-12-13T21:01:57.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18572024-12-13T21:01:57.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
18582024-12-13T21:01:57.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.059517ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
18592024-12-13T21:01:57.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 312bb750-2b50-4ef8-a283-b8adc2969a25 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18602024-12-13T21:01:57.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 312bb750-2b50-4ef8-a283-b8adc2969a25 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18612024-12-13T21:01:57.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 312bb750-2b50-4ef8-a283-b8adc2969a25 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18622024-12-13T21:01:58.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e785aca-1244-49db-a01c-28ff962b8570 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18632024-12-13T21:01:58.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e785aca-1244-49db-a01c-28ff962b8570 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18642024-12-13T21:01:58.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e785aca-1244-49db-a01c-28ff962b8570 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18652024-12-13T21:01:59.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f3caff05-0f1f-42fd-be53-f262d9eb50b2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18662024-12-13T21:01:59.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f3caff05-0f1f-42fd-be53-f262d9eb50b2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18672024-12-13T21:01:59.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f3caff05-0f1f-42fd-be53-f262d9eb50b2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18682024-12-13T21:02:00.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0fa46caf-c72f-476d-b9ed-0c1a953a8898 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18692024-12-13T21:02:00.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0fa46caf-c72f-476d-b9ed-0c1a953a8898 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18702024-12-13T21:02:00.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0fa46caf-c72f-476d-b9ed-0c1a953a8898 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18712024-12-13T21:02:01.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 07716e51-bc9a-4838-bfc6-00153679e95e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18722024-12-13T21:02:01.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 07716e51-bc9a-4838-bfc6-00153679e95e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18732024-12-13T21:02:01.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 07716e51-bc9a-4838-bfc6-00153679e95e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18742024-12-13T21:02:02.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 31ee49a7-96fb-47b7-b995-10dd345627ef roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18752024-12-13T21:02:02.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 31ee49a7-96fb-47b7-b995-10dd345627ef resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18762024-12-13T21:02:02.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 31ee49a7-96fb-47b7-b995-10dd345627ef response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18772024-12-13T21:02:03.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f02efa35-a636-49c6-98d8-9a3a36ad9460 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18782024-12-13T21:02:03.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f02efa35-a636-49c6-98d8-9a3a36ad9460 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18792024-12-13T21:02:03.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f02efa35-a636-49c6-98d8-9a3a36ad9460 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18802024-12-13T21:02:04.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ddeb61e5-4062-43ee-a9dd-742d61ba8486 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18812024-12-13T21:02:04.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ddeb61e5-4062-43ee-a9dd-742d61ba8486 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18822024-12-13T21:02:04.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ddeb61e5-4062-43ee-a9dd-742d61ba8486 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18832024-12-13T21:02:05.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed4d0906-b982-4a68-9847-96bda60c72d3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18842024-12-13T21:02:05.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed4d0906-b982-4a68-9847-96bda60c72d3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18852024-12-13T21:02:05.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed4d0906-b982-4a68-9847-96bda60c72d3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18862024-12-13T21:02:06.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d54c6a4-9170-4908-8829-c3cbbcd94e34 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18872024-12-13T21:02:06.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d54c6a4-9170-4908-8829-c3cbbcd94e34 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18882024-12-13T21:02:06.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d54c6a4-9170-4908-8829-c3cbbcd94e34 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
18892024-12-13T21:02:07.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1224 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c6197bfa-262e-43e7-8d5a-64399f4aaac5 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
18902024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
18912024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18922024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
18932024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
18942024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18952024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18962024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18972024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
18982024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18992024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
19002024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19012024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
19022024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19032024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
19042024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
19052024-12-13T21:02:07.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19062024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19072024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
19082024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
19092024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19102024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
19112024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19122024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19132024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
19142024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
19152024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19162024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19172024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19182024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19192024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19202024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19212024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19222024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19232024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19242024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19252024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19262024-12-13T21:02:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19272024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19282024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19292024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
19302024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19312024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
19322024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
19332024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19342024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19352024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
19362024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19372024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19382024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19392024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19402024-12-13T21:02:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19412024-12-13T21:02:07.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19422024-12-13T21:02:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19432024-12-13T21:02:07.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442024-12-13T21:02:07.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.016054ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19452024-12-13T21:02:07.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19462024-12-13T21:02:07.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1169, tv_nsec: 242844658 } })
19472024-12-13T21:02:07.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19482024-12-13T21:02:07.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19492024-12-13T21:02:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19502024-12-13T21:02:07.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19512024-12-13T21:02:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19522024-12-13T21:02:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19532024-12-13T21:02:07.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19542024-12-13T21:02:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19552024-12-13T21:02:07.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19562024-12-13T21:02:07.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19572024-12-13T21:02:07.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19582024-12-13T21:02:07.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1169, tv_nsec: 246376379 } })
19592024-12-13T21:02:07.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
19602024-12-13T21:02:07.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19612024-12-13T21:02:07.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19622024-12-13T21:02:07.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19632024-12-13T21:02:07.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19642024-12-13T21:02:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19652024-12-13T21:02:07.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19662024-12-13T21:02:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19672024-12-13T21:02:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19682024-12-13T21:02:07.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.000709ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19692024-12-13T21:02:07.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19702024-12-13T21:02:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19712024-12-13T21:02:07.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1169, tv_nsec: 254620563 } })
19722024-12-13T21:02:07.742ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
19732024-12-13T21:02:07.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19742024-12-13T21:02:07.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19752024-12-13T21:02:07.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19762024-12-13T21:02:07.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.600462ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
19772024-12-13T21:02:07.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19782024-12-13T21:02:07.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19792024-12-13T21:02:07.767ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19802024-12-13T21:02:07.767ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19812024-12-13T21:02:07.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19822024-12-13T21:02:07.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19832024-12-13T21:02:07.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19842024-12-13T21:02:07.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19852024-12-13T21:02:07.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19862024-12-13T21:02:07.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19872024-12-13T21:02:07.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19882024-12-13T21:02:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19892024-12-13T21:02:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19902024-12-13T21:02:07.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19912024-12-13T21:02:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19922024-12-13T21:02:07.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19932024-12-13T21:02:07.778ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19942024-12-13T21:02:07.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19952024-12-13T21:02:07.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19962024-12-13T21:02:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19972024-12-13T21:02:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19982024-12-13T21:02:07.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.596848ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
19992024-12-13T21:02:07.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20002024-12-13T21:02:07.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20012024-12-13T21:02:07.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
20022024-12-13T21:02:07.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20032024-12-13T21:02:07.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20042024-12-13T21:02:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20052024-12-13T21:02:07.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20062024-12-13T21:02:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20072024-12-13T21:02:07.797ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20082024-12-13T21:02:07.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.394778ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20092024-12-13T21:02:07.800ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
20102024-12-13T21:02:07.800ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.781929ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
20112024-12-13T21:02:07.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20122024-12-13T21:02:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20132024-12-13T21:02:07.807ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20142024-12-13T21:02:07.807ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20152024-12-13T21:02:07.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20162024-12-13T21:02:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20172024-12-13T21:02:07.811ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20182024-12-13T21:02:07.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.271362ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20192024-12-13T21:02:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20202024-12-13T21:02:07.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.569754ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20212024-12-13T21:02:07.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20222024-12-13T21:02:07.824ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20232024-12-13T21:02:07.825ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bffdf54b-b05c-4399-9582-9773ddf2a2c8", "content-length": "26", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20242024-12-13T21:02:07.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20252024-12-13T21:02:07.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20262024-12-13T21:02:07.831ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
20272024-12-13T21:02:07.832ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20282024-12-13T21:02:07.832ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b7ffc23-76bd-4977-994f-4141605a6c0d", "content-length": "26", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20292024-12-13T21:02:07.832ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20302024-12-13T21:02:07.833ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
20312024-12-13T21:02:07.852ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20322024-12-13T21:02:07.852ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20332024-12-13T21:02:07.853ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f865b67-da91-43db-a166-9e94021bdb7c", "content-length": "26", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20342024-12-13T21:02:07.853ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20352024-12-13T21:02:07.854ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20362024-12-13T21:02:07.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20372024-12-13T21:02:07.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20382024-12-13T21:02:07.935ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20392024-12-13T21:02:07.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20402024-12-13T21:02:07.936ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.024593ms iteration = 10 status = {}
20412024-12-13T21:02:07.936ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7051b2aa-f5a7-48eb-bc90-c4eb050d451c", "content-length": "372", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20422024-12-13T21:02:07.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20432024-12-13T21:02:07.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20442024-12-13T21:02:07.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20452024-12-13T21:02:07.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20462024-12-13T21:02:07.946ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 221.351811ms iteration = 13 status = {"physical_disks_added":0}
20472024-12-13T21:02:07.954ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20482024-12-13T21:02:07.954ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a0caac7-e327-466e-a169-ae42e9ee7b8e", "content-length": "1", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20492024-12-13T21:02:07.956ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20502024-12-13T21:02:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20512024-12-13T21:02:07.959ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.00185ms iteration = 10 status = null
20522024-12-13T21:02:07.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 242.663505ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
20532024-12-13T21:02:07.970ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20542024-12-13T21:02:07.970ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20552024-12-13T21:02:07.970ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 245.114318ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20562024-12-13T21:02:07.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20572024-12-13T21:02:07.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20582024-12-13T21:02:07.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20592024-12-13T21:02:07.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20602024-12-13T21:02:07.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20612024-12-13T21:02:07.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20622024-12-13T21:02:07.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = adc4b117-7e78-4b46-8cf1-c541a3c223a7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
20632024-12-13T21:02:07.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = adc4b117-7e78-4b46-8cf1-c541a3c223a7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
20642024-12-13T21:02:07.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20652024-12-13T21:02:07.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20662024-12-13T21:02:07.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20672024-12-13T21:02:07.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
20682024-12-13T21:02:07.981ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20692024-12-13T21:02:07.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20702024-12-13T21:02:07.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = adc4b117-7e78-4b46-8cf1-c541a3c223a7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
20712024-12-13T21:02:07.987ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 262.605272ms iteration = 10 status = 0
20722024-12-13T21:02:07.989ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20732024-12-13T21:02:07.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20742024-12-13T21:02:07.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c61adaac-e4e7-4a9a-bb5d-a3fc8b13522a", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20752024-12-13T21:02:07.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20762024-12-13T21:02:07.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20772024-12-13T21:02:07.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20782024-12-13T21:02:07.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20792024-12-13T21:02:07.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20802024-12-13T21:02:07.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20812024-12-13T21:02:07.999ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20822024-12-13T21:02:07.999ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20832024-12-13T21:02:07.999ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d879fc3c-3e90-4f06-943c-1ca995510fb7", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20842024-12-13T21:02:08.002ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.78926ms iteration = 11 status = {}
20852024-12-13T21:02:08.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20862024-12-13T21:02:08.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20872024-12-13T21:02:08.023ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
20882024-12-13T21:02:08.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20892024-12-13T21:02:08.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20902024-12-13T21:02:08.039ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20912024-12-13T21:02:08.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad4c23ab-b97a-4cae-b26f-9cdb35a4c271", "content-length": "134", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
20922024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20932024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
20942024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20952024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20962024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20972024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20982024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20992024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21002024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21012024-12-13T21:02:08.040ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21022024-12-13T21:02:08.041ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
21032024-12-13T21:02:08.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21042024-12-13T21:02:08.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21052024-12-13T21:02:08.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21062024-12-13T21:02:08.043ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e73110-127f-4930-85a5-2d08e7726d7c", "content-length": "2", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
21072024-12-13T21:02:08.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21082024-12-13T21:02:08.044ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "949436a9-e08f-4cd4-8f72-e8d578015126", "content-length": "52", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
21092024-12-13T21:02:08.044ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
21102024-12-13T21:02:08.044ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21112024-12-13T21:02:08.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21122024-12-13T21:02:08.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8d481717-aca9-4d68-8081-4d43f905f016", "date": "Fri, 13 Dec 2024 21:02:07 GMT"} })
21132024-12-13T21:02:08.136ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
21142024-12-13T21:02:08.136ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21152024-12-13T21:02:08.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3268c8e-aa97-4ec2-b7e2-dd7d114ba45e", "content-length": "682", "date": "Fri, 13 Dec 2024 21:02:08 GMT"} })
21162024-12-13T21:02:08.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21172024-12-13T21:02:08.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21182024-12-13T21:02:08.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "64a630d5-573d-45b9-920e-7dddbcf0d516", "content-length": "691", "date": "Fri, 13 Dec 2024 21:02:08 GMT"} })
21192024-12-13T21:02:08.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21202024-12-13T21:02:08.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21212024-12-13T21:02:08.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21222024-12-13T21:02:08.139ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.284596ms iteration = 10 status = {}
21232024-12-13T21:02:08.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21242024-12-13T21:02:08.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21252024-12-13T21:02:08.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21262024-12-13T21:02:08.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21272024-12-13T21:02:08.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21282024-12-13T21:02:08.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21292024-12-13T21:02:08.164ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 438.864213ms iteration = 10 status = {}
21302024-12-13T21:02:09.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 07be13d0-754e-4112-a2e5-109ec4b38fa7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21312024-12-13T21:02:09.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 07be13d0-754e-4112-a2e5-109ec4b38fa7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21322024-12-13T21:02:09.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 07be13d0-754e-4112-a2e5-109ec4b38fa7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21332024-12-13T21:02:09.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ef688b83-a72b-49c4-b078-eb19d68440ba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21342024-12-13T21:02:09.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ef688b83-a72b-49c4-b078-eb19d68440ba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21352024-12-13T21:02:09.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ef688b83-a72b-49c4-b078-eb19d68440ba response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21362024-12-13T21:02:10.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad6e8866-f758-473e-a216-0251dfae6e5b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21372024-12-13T21:02:10.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad6e8866-f758-473e-a216-0251dfae6e5b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21382024-12-13T21:02:10.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad6e8866-f758-473e-a216-0251dfae6e5b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21392024-12-13T21:02:11.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 96aac4c0-5dae-426f-a232-e80984e4d930 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21402024-12-13T21:02:11.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 96aac4c0-5dae-426f-a232-e80984e4d930 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21412024-12-13T21:02:11.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 96aac4c0-5dae-426f-a232-e80984e4d930 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21422024-12-13T21:02:12.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb53d71e-6d82-4839-a78c-90ebe5157874 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21432024-12-13T21:02:12.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb53d71e-6d82-4839-a78c-90ebe5157874 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21442024-12-13T21:02:12.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb53d71e-6d82-4839-a78c-90ebe5157874 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21452024-12-13T21:02:13.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 963a14d7-22dd-41e0-8c66-0d55159d99c0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21462024-12-13T21:02:13.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 963a14d7-22dd-41e0-8c66-0d55159d99c0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21472024-12-13T21:02:13.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 963a14d7-22dd-41e0-8c66-0d55159d99c0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21482024-12-13T21:02:14.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1cdfcef6-0665-459b-b420-0f306f71d00a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21492024-12-13T21:02:14.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1cdfcef6-0665-459b-b420-0f306f71d00a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21502024-12-13T21:02:14.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1cdfcef6-0665-459b-b420-0f306f71d00a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21512024-12-13T21:02:15.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 848cc88c-5bcf-4a22-af92-76bf6ae83363 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21522024-12-13T21:02:15.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 848cc88c-5bcf-4a22-af92-76bf6ae83363 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21532024-12-13T21:02:15.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 848cc88c-5bcf-4a22-af92-76bf6ae83363 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21542024-12-13T21:02:16.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7d06749-6c02-4ef7-8e8d-95766c981ee4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21552024-12-13T21:02:16.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7d06749-6c02-4ef7-8e8d-95766c981ee4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21562024-12-13T21:02:16.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7d06749-6c02-4ef7-8e8d-95766c981ee4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21572024-12-13T21:02:17.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c998a7bf-3b5d-4067-9103-6f551acdf2ed roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21582024-12-13T21:02:17.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c998a7bf-3b5d-4067-9103-6f551acdf2ed resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21592024-12-13T21:02:17.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c998a7bf-3b5d-4067-9103-6f551acdf2ed response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21602024-12-13T21:02:17.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1309 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = fc16f1f5-edbc-436d-a52a-d8cddc97b38e response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
21612024-12-13T21:02:17.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
21622024-12-13T21:02:17.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
21632024-12-13T21:02:17.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21642024-12-13T21:02:17.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652024-12-13T21:02:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21662024-12-13T21:02:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21672024-12-13T21:02:17.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21682024-12-13T21:02:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21692024-12-13T21:02:17.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21702024-12-13T21:02:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21712024-12-13T21:02:17.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21722024-12-13T21:02:17.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21732024-12-13T21:02:17.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21742024-12-13T21:02:17.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
21752024-12-13T21:02:17.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21762024-12-13T21:02:17.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21772024-12-13T21:02:17.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
21782024-12-13T21:02:17.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.143308ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
21792024-12-13T21:02:17.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21802024-12-13T21:02:17.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21812024-12-13T21:02:17.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.714527ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21822024-12-13T21:02:18.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3303f8ff-bac2-4329-81fb-7a5c82db41ee roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21832024-12-13T21:02:18.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3303f8ff-bac2-4329-81fb-7a5c82db41ee resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21842024-12-13T21:02:18.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3303f8ff-bac2-4329-81fb-7a5c82db41ee response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21852024-12-13T21:02:19.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fc5e089-9aaf-4a9d-95fa-5fc5f97d862b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21862024-12-13T21:02:19.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fc5e089-9aaf-4a9d-95fa-5fc5f97d862b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21872024-12-13T21:02:19.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fc5e089-9aaf-4a9d-95fa-5fc5f97d862b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21882024-12-13T21:02:20.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d07dce83-6ed8-4db4-a47b-64bf76e7e8c1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21892024-12-13T21:02:20.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d07dce83-6ed8-4db4-a47b-64bf76e7e8c1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21902024-12-13T21:02:20.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d07dce83-6ed8-4db4-a47b-64bf76e7e8c1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21912024-12-13T21:02:21.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d0ca9801-2b0e-433a-bd97-034bb1a6d353 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21922024-12-13T21:02:21.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d0ca9801-2b0e-433a-bd97-034bb1a6d353 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21932024-12-13T21:02:21.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d0ca9801-2b0e-433a-bd97-034bb1a6d353 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21942024-12-13T21:02:22.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26c627c4-fb23-40ee-8e23-5fd674931bb6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21952024-12-13T21:02:22.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26c627c4-fb23-40ee-8e23-5fd674931bb6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21962024-12-13T21:02:22.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26c627c4-fb23-40ee-8e23-5fd674931bb6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21972024-12-13T21:02:23.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4662e1c2-7487-44b3-85ef-c1bd1f94d047 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21982024-12-13T21:02:23.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4662e1c2-7487-44b3-85ef-c1bd1f94d047 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
21992024-12-13T21:02:23.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4662e1c2-7487-44b3-85ef-c1bd1f94d047 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22002024-12-13T21:02:24.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5cee30bd-31ad-443e-abc6-536991e0714b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22012024-12-13T21:02:24.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5cee30bd-31ad-443e-abc6-536991e0714b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22022024-12-13T21:02:24.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5cee30bd-31ad-443e-abc6-536991e0714b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22032024-12-13T21:02:25.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 46b06ca4-3ae2-4a91-b629-47e4d6dc25c3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22042024-12-13T21:02:25.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 46b06ca4-3ae2-4a91-b629-47e4d6dc25c3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22052024-12-13T21:02:25.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 46b06ca4-3ae2-4a91-b629-47e4d6dc25c3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22062024-12-13T21:02:26.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78e0125a-0186-42b4-b67d-7e956ff45249 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22072024-12-13T21:02:26.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78e0125a-0186-42b4-b67d-7e956ff45249 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22082024-12-13T21:02:26.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78e0125a-0186-42b4-b67d-7e956ff45249 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22092024-12-13T21:02:27.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e7e6c22a-8481-4e08-83eb-817c74dc3693 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22102024-12-13T21:02:27.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e7e6c22a-8481-4e08-83eb-817c74dc3693 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22112024-12-13T21:02:27.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e7e6c22a-8481-4e08-83eb-817c74dc3693 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22122024-12-13T21:02:27.667ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e39d7d4e-276f-4e01-9d93-d570addeda3c response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
22132024-12-13T21:02:27.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
22142024-12-13T21:02:27.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22152024-12-13T21:02:27.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
22162024-12-13T21:02:27.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22172024-12-13T21:02:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22182024-12-13T21:02:27.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22192024-12-13T21:02:27.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22202024-12-13T21:02:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22212024-12-13T21:02:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22222024-12-13T21:02:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22232024-12-13T21:02:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22242024-12-13T21:02:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22252024-12-13T21:02:27.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22262024-12-13T21:02:27.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22272024-12-13T21:02:27.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.692306ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22282024-12-13T21:02:27.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292024-12-13T21:02:27.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
22302024-12-13T21:02:27.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22312024-12-13T21:02:27.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22322024-12-13T21:02:27.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
22332024-12-13T21:02:27.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.816572ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
22342024-12-13T21:02:28.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7102824-5a55-49d2-9bc3-5da8b4324fb6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22352024-12-13T21:02:28.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7102824-5a55-49d2-9bc3-5da8b4324fb6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22362024-12-13T21:02:28.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7102824-5a55-49d2-9bc3-5da8b4324fb6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22372024-12-13T21:02:29.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f770dc82-24ab-4bbf-b528-658991e6cf0f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22382024-12-13T21:02:29.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f770dc82-24ab-4bbf-b528-658991e6cf0f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22392024-12-13T21:02:29.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f770dc82-24ab-4bbf-b528-658991e6cf0f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22402024-12-13T21:02:30.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e6295e82-ba09-468e-8f9c-34c7582214f2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22412024-12-13T21:02:30.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e6295e82-ba09-468e-8f9c-34c7582214f2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22422024-12-13T21:02:30.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e6295e82-ba09-468e-8f9c-34c7582214f2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22432024-12-13T21:02:31.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4d218cf-1e01-49a8-9bd4-e6b211631b38 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22442024-12-13T21:02:31.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4d218cf-1e01-49a8-9bd4-e6b211631b38 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22452024-12-13T21:02:31.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4d218cf-1e01-49a8-9bd4-e6b211631b38 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22462024-12-13T21:02:32.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb3b9657-8575-4d18-84f2-2b28a7c42262 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22472024-12-13T21:02:32.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb3b9657-8575-4d18-84f2-2b28a7c42262 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22482024-12-13T21:02:32.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb3b9657-8575-4d18-84f2-2b28a7c42262 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22492024-12-13T21:02:33.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b767ddc8-5666-47dc-a1d1-4a24b4b90d45 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22502024-12-13T21:02:33.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b767ddc8-5666-47dc-a1d1-4a24b4b90d45 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22512024-12-13T21:02:33.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b767ddc8-5666-47dc-a1d1-4a24b4b90d45 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22522024-12-13T21:02:34.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e2ca240-4a01-45db-b7f5-1636a1f63739 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22532024-12-13T21:02:34.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e2ca240-4a01-45db-b7f5-1636a1f63739 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22542024-12-13T21:02:34.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e2ca240-4a01-45db-b7f5-1636a1f63739 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22552024-12-13T21:02:35.511ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63685
22562024-12-13T21:02:35.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63685 req_id = ee8abf87-069f-4086-88ab-10ac17ecfee2 roles = RoleSet { roles: {} } uri = /metrics/producers
22572024-12-13T21:02:35.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63685 req_id = ee8abf87-069f-4086-88ab-10ac17ecfee2 resource = Database result = Ok(()) uri = /metrics/producers
22582024-12-13T21:02:35.546ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 9808715c-dad7-4981-b1eb-a6013e471643
22592024-12-13T21:02:35.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34959 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63685 req_id = ee8abf87-069f-4086-88ab-10ac17ecfee2 response_code = 201 uri = /metrics/producers
22602024-12-13T21:02:35.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 80bb32bb-6c67-4d14-acaf-fb4a744a756f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22612024-12-13T21:02:35.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 80bb32bb-6c67-4d14-acaf-fb4a744a756f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22622024-12-13T21:02:35.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 80bb32bb-6c67-4d14-acaf-fb4a744a756f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22632024-12-13T21:02:36.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 561e7ee2-0d42-48c8-9a3d-f18e9b56816d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22642024-12-13T21:02:36.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 561e7ee2-0d42-48c8-9a3d-f18e9b56816d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22652024-12-13T21:02:36.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 561e7ee2-0d42-48c8-9a3d-f18e9b56816d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22662024-12-13T21:02:37.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 551552cd-8115-4ea3-af4b-97ebf4bce932 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22672024-12-13T21:02:37.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 551552cd-8115-4ea3-af4b-97ebf4bce932 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22682024-12-13T21:02:37.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 551552cd-8115-4ea3-af4b-97ebf4bce932 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
22692024-12-13T21:02:37.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a6031775-b508-4a33-ba3a-3b07e45336a9 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
22702024-12-13T21:02:37.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
22712024-12-13T21:02:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
22722024-12-13T21:02:37.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22732024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
22742024-12-13T21:02:37.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22752024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22762024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
22772024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
22782024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
22792024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
22802024-12-13T21:02:37.725ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
22812024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22822024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22832024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22842024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
22852024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
22862024-12-13T21:02:37.725ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
22872024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22882024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
22892024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.89\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
22902024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22912024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22922024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
22932024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22942024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
22952024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22962024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
22972024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22982024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
22992024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
23002024-12-13T21:02:37.725ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23012024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23022024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23032024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
23042024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
23052024-12-13T21:02:37.725ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:52:37.725202106 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23062024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23072024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
23082024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
23092024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23102024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23112024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
23122024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23132024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23142024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
23152024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
23162024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23172024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
23182024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23192024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23202024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
23212024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23222024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
23232024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
23242024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23252024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
23262024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23272024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
23282024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23292024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
23302024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23312024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
23322024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23332024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
23342024-12-13T21:02:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23352024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23362024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23372024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23382024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23392024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23402024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23412024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23422024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23432024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23442024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23452024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23462024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23472024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23482024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23492024-12-13T21:02:37.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 238722804 } })
23502024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23512024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23522024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23532024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23542024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23552024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23562024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23572024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23582024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23592024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23602024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23612024-12-13T21:02:37.726ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 238894718 } })
23622024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23632024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.553811ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23642024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23652024-12-13T21:02:37.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.825767ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23662024-12-13T21:02:37.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 240969502 } })
23672024-12-13T21:02:37.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682024-12-13T21:02:37.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23692024-12-13T21:02:37.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.87265ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23702024-12-13T21:02:37.729ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23712024-12-13T21:02:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23722024-12-13T21:02:37.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23732024-12-13T21:02:37.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23742024-12-13T21:02:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23752024-12-13T21:02:37.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23762024-12-13T21:02:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23772024-12-13T21:02:37.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782024-12-13T21:02:37.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 247669626 } })
23792024-12-13T21:02:37.735ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23802024-12-13T21:02:37.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23812024-12-13T21:02:37.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23822024-12-13T21:02:37.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23832024-12-13T21:02:37.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23842024-12-13T21:02:37.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23852024-12-13T21:02:37.739ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:52:37.725202106 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23862024-12-13T21:02:37.739ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.161267ms iteration = 6 status = {"expiration":"2024-12-13T20:52:37.725202106Z","pruned":[]}
23872024-12-13T21:02:37.740ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.359708ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
23882024-12-13T21:02:37.742ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23892024-12-13T21:02:37.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23902024-12-13T21:02:37.768ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-12-13T21:02:37.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23922024-12-13T21:02:37.771ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23932024-12-13T21:02:37.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23942024-12-13T21:02:37.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23952024-12-13T21:02:37.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23962024-12-13T21:02:37.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23972024-12-13T21:02:37.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23982024-12-13T21:02:37.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23992024-12-13T21:02:37.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24002024-12-13T21:02:37.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24012024-12-13T21:02:37.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24022024-12-13T21:02:37.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24032024-12-13T21:02:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24042024-12-13T21:02:37.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24052024-12-13T21:02:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24062024-12-13T21:02:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24072024-12-13T21:02:37.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24082024-12-13T21:02:37.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24092024-12-13T21:02:37.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24102024-12-13T21:02:37.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24112024-12-13T21:02:37.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24122024-12-13T21:02:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24132024-12-13T21:02:37.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24142024-12-13T21:02:37.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24152024-12-13T21:02:37.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24162024-12-13T21:02:37.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24172024-12-13T21:02:37.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24182024-12-13T21:02:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24192024-12-13T21:02:37.783ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24202024-12-13T21:02:37.783ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24212024-12-13T21:02:37.783ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24222024-12-13T21:02:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24232024-12-13T21:02:37.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24242024-12-13T21:02:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24252024-12-13T21:02:37.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24262024-12-13T21:02:37.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272024-12-13T21:02:37.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24282024-12-13T21:02:37.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.580452ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24292024-12-13T21:02:37.786ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24302024-12-13T21:02:37.786ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24312024-12-13T21:02:37.786ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.91328ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24322024-12-13T21:02:37.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24332024-12-13T21:02:37.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.14233ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
24342024-12-13T21:02:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24352024-12-13T21:02:37.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24362024-12-13T21:02:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24372024-12-13T21:02:37.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24382024-12-13T21:02:37.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24392024-12-13T21:02:37.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402024-12-13T21:02:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24412024-12-13T21:02:37.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24422024-12-13T21:02:37.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24432024-12-13T21:02:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24442024-12-13T21:02:37.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24452024-12-13T21:02:37.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
24462024-12-13T21:02:37.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24472024-12-13T21:02:37.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24482024-12-13T21:02:37.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24492024-12-13T21:02:37.796ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 309150801 } })
24502024-12-13T21:02:37.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24512024-12-13T21:02:37.796ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
24522024-12-13T21:02:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24532024-12-13T21:02:37.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.457265ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
24542024-12-13T21:02:37.799ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24552024-12-13T21:02:37.799ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24562024-12-13T21:02:37.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24572024-12-13T21:02:37.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24582024-12-13T21:02:37.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24592024-12-13T21:02:37.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24602024-12-13T21:02:37.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24612024-12-13T21:02:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24622024-12-13T21:02:37.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24632024-12-13T21:02:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24642024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24652024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24662024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24672024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24682024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
24692024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.303678ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
24702024-12-13T21:02:37.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24712024-12-13T21:02:37.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24722024-12-13T21:02:37.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.394854ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24732024-12-13T21:02:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24742024-12-13T21:02:37.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24752024-12-13T21:02:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24762024-12-13T21:02:37.829ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24772024-12-13T21:02:37.829ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24782024-12-13T21:02:37.829ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24792024-12-13T21:02:37.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24802024-12-13T21:02:37.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24812024-12-13T21:02:37.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24822024-12-13T21:02:37.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24832024-12-13T21:02:37.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24842024-12-13T21:02:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24852024-12-13T21:02:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24862024-12-13T21:02:37.832ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24872024-12-13T21:02:37.832ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24882024-12-13T21:02:37.832ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.713594ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24892024-12-13T21:02:37.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24902024-12-13T21:02:37.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24912024-12-13T21:02:37.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24922024-12-13T21:02:37.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24932024-12-13T21:02:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24942024-12-13T21:02:37.836ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24952024-12-13T21:02:37.836ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24962024-12-13T21:02:37.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.153233ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24972024-12-13T21:02:37.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24982024-12-13T21:02:37.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
25002024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25012024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.196503ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25022024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25032024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25042024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25052024-12-13T21:02:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25062024-12-13T21:02:37.843ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.819052ms iteration = 11 status = 0
25072024-12-13T21:02:37.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25082024-12-13T21:02:37.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25092024-12-13T21:02:37.846ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25102024-12-13T21:02:37.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.249975ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25112024-12-13T21:02:37.846ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25122024-12-13T21:02:37.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25132024-12-13T21:02:37.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25142024-12-13T21:02:37.848ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25152024-12-13T21:02:37.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25162024-12-13T21:02:37.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25172024-12-13T21:02:37.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25182024-12-13T21:02:37.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-12-13T21:02:37.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202024-12-13T21:02:37.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25212024-12-13T21:02:37.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25222024-12-13T21:02:37.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25232024-12-13T21:02:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25242024-12-13T21:02:37.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25252024-12-13T21:02:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25262024-12-13T21:02:37.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25272024-12-13T21:02:37.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25282024-12-13T21:02:37.855ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25292024-12-13T21:02:37.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25302024-12-13T21:02:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25312024-12-13T21:02:37.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-12-13T21:02:37.861ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25332024-12-13T21:02:37.861ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
25342024-12-13T21:02:37.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25352024-12-13T21:02:37.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25362024-12-13T21:02:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25372024-12-13T21:02:37.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25382024-12-13T21:02:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25392024-12-13T21:02:37.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25402024-12-13T21:02:37.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25412024-12-13T21:02:37.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25422024-12-13T21:02:37.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25432024-12-13T21:02:37.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25442024-12-13T21:02:37.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25452024-12-13T21:02:37.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25462024-12-13T21:02:37.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25472024-12-13T21:02:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25482024-12-13T21:02:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25492024-12-13T21:02:37.869ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25502024-12-13T21:02:37.869ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25512024-12-13T21:02:37.869ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25522024-12-13T21:02:37.869ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25532024-12-13T21:02:37.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25542024-12-13T21:02:37.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25552024-12-13T21:02:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25562024-12-13T21:02:37.869ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "074dbd36-1dce-44ee-a937-d3a65cc00455", "content-length": "26", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
25572024-12-13T21:02:37.869ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25582024-12-13T21:02:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25592024-12-13T21:02:37.870ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25602024-12-13T21:02:37.870ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25612024-12-13T21:02:37.870ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4c6598-4818-48e4-853c-02ec3d9e5284", "content-length": "26", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
25622024-12-13T21:02:37.870ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25632024-12-13T21:02:37.871ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
25642024-12-13T21:02:37.871ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25652024-12-13T21:02:37.871ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
25662024-12-13T21:02:37.871ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 145.839973ms iteration = 7 status = {"generation":2}
25672024-12-13T21:02:37.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25682024-12-13T21:02:37.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692024-12-13T21:02:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25702024-12-13T21:02:37.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25712024-12-13T21:02:37.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25722024-12-13T21:02:37.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25732024-12-13T21:02:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25742024-12-13T21:02:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25752024-12-13T21:02:37.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25762024-12-13T21:02:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25772024-12-13T21:02:37.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 150.809561ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25782024-12-13T21:02:37.881ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25792024-12-13T21:02:37.881ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25802024-12-13T21:02:37.881ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
25812024-12-13T21:02:37.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.018736ms iteration = 7 status = {"generation":1}
25822024-12-13T21:02:37.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25832024-12-13T21:02:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25842024-12-13T21:02:37.897ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
25852024-12-13T21:02:37.897ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.32767ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25862024-12-13T21:02:37.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25872024-12-13T21:02:37.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25882024-12-13T21:02:37.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25892024-12-13T21:02:37.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25902024-12-13T21:02:37.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
25912024-12-13T21:02:37.956ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25922024-12-13T21:02:37.956ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ab20659-9be6-4ef2-ae5b-37ca76cdaaaf", "content-length": "26", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
25932024-12-13T21:02:37.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25942024-12-13T21:02:37.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25952024-12-13T21:02:37.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25962024-12-13T21:02:37.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
25972024-12-13T21:02:37.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25982024-12-13T21:02:37.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25992024-12-13T21:02:37.962ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26002024-12-13T21:02:37.962ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 236.768742ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26012024-12-13T21:02:37.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26022024-12-13T21:02:37.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26032024-12-13T21:02:37.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26042024-12-13T21:02:37.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26052024-12-13T21:02:37.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26062024-12-13T21:02:37.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26072024-12-13T21:02:37.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26082024-12-13T21:02:37.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26092024-12-13T21:02:37.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26102024-12-13T21:02:37.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26112024-12-13T21:02:37.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26122024-12-13T21:02:37.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26132024-12-13T21:02:37.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26142024-12-13T21:02:37.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26152024-12-13T21:02:37.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26162024-12-13T21:02:37.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26172024-12-13T21:02:37.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26182024-12-13T21:02:37.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26192024-12-13T21:02:37.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26202024-12-13T21:02:37.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212024-12-13T21:02:37.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26222024-12-13T21:02:37.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26232024-12-13T21:02:37.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26242024-12-13T21:02:37.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26252024-12-13T21:02:37.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26262024-12-13T21:02:37.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26272024-12-13T21:02:37.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26282024-12-13T21:02:37.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26292024-12-13T21:02:37.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26302024-12-13T21:02:37.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26312024-12-13T21:02:37.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26322024-12-13T21:02:37.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26332024-12-13T21:02:37.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26342024-12-13T21:02:37.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26352024-12-13T21:02:37.996ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 271.81196ms iteration = 14 status = {"physical_disks_added":0}
26362024-12-13T21:02:37.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26372024-12-13T21:02:37.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26382024-12-13T21:02:38.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26392024-12-13T21:02:38.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26402024-12-13T21:02:38.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26412024-12-13T21:02:38.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26422024-12-13T21:02:38.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26432024-12-13T21:02:38.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26442024-12-13T21:02:38.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26452024-12-13T21:02:38.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26462024-12-13T21:02:38.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26472024-12-13T21:02:38.018ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26482024-12-13T21:02:38.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26492024-12-13T21:02:38.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26502024-12-13T21:02:38.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26512024-12-13T21:02:38.029ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0384a0a4-cd1e-4d85-ab2e-b6a0b8ff948f", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26522024-12-13T21:02:38.029ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26532024-12-13T21:02:38.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "caa72c76-b841-4e9b-859c-427b179e6376", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26542024-12-13T21:02:38.031ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26552024-12-13T21:02:38.032ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26562024-12-13T21:02:38.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.769203ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26572024-12-13T21:02:38.052ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26582024-12-13T21:02:38.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26592024-12-13T21:02:38.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26602024-12-13T21:02:38.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26612024-12-13T21:02:38.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26622024-12-13T21:02:38.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26632024-12-13T21:02:38.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26642024-12-13T21:02:38.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26652024-12-13T21:02:38.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26662024-12-13T21:02:38.078ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0911bf9a-fb79-4e5a-84d1-2af61004bd4d, kind: Service { id: 8fa769ab-44ab-4529-aca4-cf239281d788 }, name: Name("external-dns-8fa769ab-44ab-4529-aca4-cf239281d788"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a04b2ab8-04f1-43b7-88cb-9af608150cb1, kind: Service { id: d9f46008-cfe6-449f-ba60-44c3baf9576d }, name: Name("external-dns-d9f46008-cfe6-449f-ba60-44c3baf9576d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 56])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0fcf3183-4482-4760-b10e-911ba8d847a4, kind: Service { id: 6e83647a-e5c1-40cc-a3f0-e80da403da03 }, name: Name("nexus-6e83647a-e5c1-40cc-a3f0-e80da403da03"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 11773aea-5e51-4630-a9e1-0fd47cc496d7, kind: Service { id: 0599e804-8800-4951-9d87-7a8a49a507a3 }, name: Name("nexus-0599e804-8800-4951-9d87-7a8a49a507a3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729f1ae5-19c6-4d46-aed9-eddb07ffd985, kind: Service { id: afa82dce-5a21-405b-9d0f-a4070132ff96 }, name: Name("nexus-afa82dce-5a21-405b-9d0f-a4070132ff96"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
26672024-12-13T21:02:38.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26682024-12-13T21:02:38.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26692024-12-13T21:02:38.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702024-12-13T21:02:38.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
26712024-12-13T21:02:38.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26722024-12-13T21:02:38.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26732024-12-13T21:02:38.083ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
26742024-12-13T21:02:38.084ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0911bf9a-fb79-4e5a-84d1-2af61004bd4d, kind: Service { id: 8fa769ab-44ab-4529-aca4-cf239281d788 }, name: Name("external-dns-8fa769ab-44ab-4529-aca4-cf239281d788"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a04b2ab8-04f1-43b7-88cb-9af608150cb1, kind: Service { id: d9f46008-cfe6-449f-ba60-44c3baf9576d }, name: Name("external-dns-d9f46008-cfe6-449f-ba60-44c3baf9576d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 56])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0fcf3183-4482-4760-b10e-911ba8d847a4, kind: Service { id: 6e83647a-e5c1-40cc-a3f0-e80da403da03 }, name: Name("nexus-6e83647a-e5c1-40cc-a3f0-e80da403da03"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 11773aea-5e51-4630-a9e1-0fd47cc496d7, kind: Service { id: 0599e804-8800-4951-9d87-7a8a49a507a3 }, name: Name("nexus-0599e804-8800-4951-9d87-7a8a49a507a3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729f1ae5-19c6-4d46-aed9-eddb07ffd985, kind: Service { id: afa82dce-5a21-405b-9d0f-a4070132ff96 }, name: Name("nexus-afa82dce-5a21-405b-9d0f-a4070132ff96"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
26752024-12-13T21:02:38.084ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
26762024-12-13T21:02:38.173ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26772024-12-13T21:02:38.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26782024-12-13T21:02:38.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3499945-b18b-443b-b3cf-2eee886e9c37", "content-length": "372", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
26792024-12-13T21:02:38.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26802024-12-13T21:02:38.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26812024-12-13T21:02:38.178ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.75533ms iteration = 11 status = {}
26822024-12-13T21:02:38.182ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26832024-12-13T21:02:38.182ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e557ed2e-a15b-4c4d-a325-360472324d73", "content-length": "1", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
26842024-12-13T21:02:38.184ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26852024-12-13T21:02:38.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26862024-12-13T21:02:38.187ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.308561ms iteration = 11 status = null
26872024-12-13T21:02:38.193ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 82024834-9725-4304-9edd-af6b519041b3, time_created: 2024-12-13T20:58:05.394560Z, time_modified: 2024-12-13T20:58:05.394560Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
26882024-12-13T21:02:38.193ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
26892024-12-13T21:02:38.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26902024-12-13T21:02:38.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26912024-12-13T21:02:38.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26922024-12-13T21:02:38.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26932024-12-13T21:02:38.199ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26942024-12-13T21:02:38.200ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e3892186-105b-4855-adba-7119f3c8abc4", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26952024-12-13T21:02:38.200ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26962024-12-13T21:02:38.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cbfe317d-19fb-43a0-8848-1dc8b4936b6a", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26972024-12-13T21:02:38.201ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26982024-12-13T21:02:38.203ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ad131055-d2d9-47f4-8bf5-d774bd171254", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26992024-12-13T21:02:38.203ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27002024-12-13T21:02:38.205ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27012024-12-13T21:02:38.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 480.826651ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27022024-12-13T21:02:38.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27032024-12-13T21:02:38.209ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "54a8cc93-29c7-49c0-b921-bd1dfca9a0bf", "content-length": "691", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
27042024-12-13T21:02:38.209ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27052024-12-13T21:02:38.209ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27062024-12-13T21:02:38.209ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27072024-12-13T21:02:38.211ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 485.826312ms iteration = 11 status = {}
27082024-12-13T21:02:38.215ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27092024-12-13T21:02:38.215ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27102024-12-13T21:02:38.215ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1a9f5895-1370-4691-9a17-7b7da053078f", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
27112024-12-13T21:02:38.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27122024-12-13T21:02:38.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27132024-12-13T21:02:38.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27142024-12-13T21:02:38.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27152024-12-13T21:02:38.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27162024-12-13T21:02:38.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27172024-12-13T21:02:38.223ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27182024-12-13T21:02:38.224ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27192024-12-13T21:02:38.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "361c3e2c-01bc-4ab2-8731-c87c560cd0bb", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
27202024-12-13T21:02:38.226ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 501.911669ms iteration = 12 status = {}
27212024-12-13T21:02:38.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27222024-12-13T21:02:38.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
27232024-12-13T21:02:38.267ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35117
27242024-12-13T21:02:38.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35117 req_id = f24b853b-6e3b-4824-a0e2-5ea3e4cc02c7 roles = RoleSet { roles: {} } uri = /metrics/producers
27252024-12-13T21:02:38.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35117 req_id = f24b853b-6e3b-4824-a0e2-5ea3e4cc02c7 resource = Database result = Ok(()) uri = /metrics/producers
27262024-12-13T21:02:38.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27272024-12-13T21:02:38.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27282024-12-13T21:02:38.301ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27292024-12-13T21:02:38.301ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "49f6a341-ca8f-4717-9b62-26001b4390f8", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
27302024-12-13T21:02:38.302ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
27312024-12-13T21:02:38.302ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 577.906059ms
27322024-12-13T21:02:38.302ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 577.920589ms iteration = 2 status = {}
27332024-12-13T21:02:38.303ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
27342024-12-13T21:02:38.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27352024-12-13T21:02:38.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27362024-12-13T21:02:38.314ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27372024-12-13T21:02:38.314ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 05a53e54-a11d-4f9d-b47d-dabf8673427d
27382024-12-13T21:02:38.314ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dfb1c88-72c0-4a9f-80b5-6190fe3b1973", "content-length": "134", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
27392024-12-13T21:02:38.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46856 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35117 req_id = f24b853b-6e3b-4824-a0e2-5ea3e4cc02c7 response_code = 201 uri = /metrics/producers
27402024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27412024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
27422024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27432024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27442024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27452024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27462024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27472024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27482024-12-13T21:02:38.314ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27492024-12-13T21:02:38.315ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27502024-12-13T21:02:38.315ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
27512024-12-13T21:02:38.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27522024-12-13T21:02:38.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27532024-12-13T21:02:38.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27542024-12-13T21:02:38.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1da22a1-f50f-4581-9f33-3b41c17feba8", "content-length": "2", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
27552024-12-13T21:02:38.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27562024-12-13T21:02:38.317ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b131a96-dc00-48b2-90dd-9eec35f1c732", "content-length": "52", "date": "Fri, 13 Dec 2024 21:02:37 GMT"} })
27572024-12-13T21:02:38.317ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
27582024-12-13T21:02:38.317ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27592024-12-13T21:02:38.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dc453c3a-a6e3-4783-979c-60180ecc9920", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
27602024-12-13T21:02:38.414ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
27612024-12-13T21:02:38.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27622024-12-13T21:02:38.418ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "71be0521-9dc9-4c81-a86d-c933b0c97817", "content-length": "682", "date": "Fri, 13 Dec 2024 21:02:38 GMT"} })
27632024-12-13T21:02:38.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27642024-12-13T21:02:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27652024-12-13T21:02:38.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27662024-12-13T21:02:38.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27672024-12-13T21:02:38.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27682024-12-13T21:02:38.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27692024-12-13T21:02:38.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27702024-12-13T21:02:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27712024-12-13T21:02:38.435ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 710.496228ms iteration = 11 status = {}
27722024-12-13T21:02:38.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 30f92d2a-3fa4-4c46-98a4-e6cfd2a5785c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27732024-12-13T21:02:38.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 30f92d2a-3fa4-4c46-98a4-e6cfd2a5785c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27742024-12-13T21:02:38.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 30f92d2a-3fa4-4c46-98a4-e6cfd2a5785c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27752024-12-13T21:02:39.118ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:59820
27762024-12-13T21:02:39.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59820 req_id = d4ad4c8d-aaa3-4129-a9b8-2e36b4907f6e roles = RoleSet { roles: {} } uri = /metrics/producers
27772024-12-13T21:02:39.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59820 req_id = d4ad4c8d-aaa3-4129-a9b8-2e36b4907f6e resource = Database result = Ok(()) uri = /metrics/producers
27782024-12-13T21:02:39.158ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 82024834-9725-4304-9edd-af6b519041b3
27792024-12-13T21:02:39.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39859 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59820 req_id = d4ad4c8d-aaa3-4129-a9b8-2e36b4907f6e response_code = 201 uri = /metrics/producers
27802024-12-13T21:02:39.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = a6a3b940-2395-4b47-ba55-bc522e2e683f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27812024-12-13T21:02:39.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = a6a3b940-2395-4b47-ba55-bc522e2e683f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27822024-12-13T21:02:39.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = a6a3b940-2395-4b47-ba55-bc522e2e683f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27832024-12-13T21:02:39.361ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48408
27842024-12-13T21:02:39.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48408 req_id = eb4fb754-2f92-4f17-a20e-bbf79b541319 roles = RoleSet { roles: {} } uri = /metrics/producers
27852024-12-13T21:02:39.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48408 req_id = eb4fb754-2f92-4f17-a20e-bbf79b541319 resource = Database result = Ok(()) uri = /metrics/producers
27862024-12-13T21:02:39.371ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 24d23071-4a22-4662-832b-fb2493a9b66b
27872024-12-13T21:02:39.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9732 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48408 req_id = eb4fb754-2f92-4f17-a20e-bbf79b541319 response_code = 201 uri = /metrics/producers
27882024-12-13T21:02:39.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 483a2781-3ff3-4307-87c7-a6d5ee71f2b1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27892024-12-13T21:02:39.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 483a2781-3ff3-4307-87c7-a6d5ee71f2b1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27902024-12-13T21:02:39.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 483a2781-3ff3-4307-87c7-a6d5ee71f2b1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27912024-12-13T21:02:40.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd0a53c6-dc98-447d-a0ff-6e70df913074 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27922024-12-13T21:02:40.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd0a53c6-dc98-447d-a0ff-6e70df913074 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27932024-12-13T21:02:40.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd0a53c6-dc98-447d-a0ff-6e70df913074 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27942024-12-13T21:02:41.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 72a4fec8-3da8-4b5c-ba1e-c374551a5551 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27952024-12-13T21:02:41.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 72a4fec8-3da8-4b5c-ba1e-c374551a5551 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27962024-12-13T21:02:41.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 72a4fec8-3da8-4b5c-ba1e-c374551a5551 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27972024-12-13T21:02:42.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 957479af-498d-4860-9504-ccef29c6cc75 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27982024-12-13T21:02:42.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 957479af-498d-4860-9504-ccef29c6cc75 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
27992024-12-13T21:02:42.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 957479af-498d-4860-9504-ccef29c6cc75 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28002024-12-13T21:02:43.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63746896-5fd2-4616-9884-3ad029785841 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28012024-12-13T21:02:43.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63746896-5fd2-4616-9884-3ad029785841 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28022024-12-13T21:02:43.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63746896-5fd2-4616-9884-3ad029785841 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28032024-12-13T21:02:43.854ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38971
28042024-12-13T21:02:43.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38971 req_id = 1bbe31bb-2793-414d-8ade-30517a06505c roles = RoleSet { roles: {} } uri = /metrics/producers
28052024-12-13T21:02:43.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38971 req_id = 1bbe31bb-2793-414d-8ade-30517a06505c resource = Database result = Ok(()) uri = /metrics/producers
28062024-12-13T21:02:43.891ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 3f777322-11c9-4c30-9537-a1cc3a15fe00
28072024-12-13T21:02:43.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37173 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38971 req_id = 1bbe31bb-2793-414d-8ade-30517a06505c response_code = 201 uri = /metrics/producers
28082024-12-13T21:02:44.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 558fb1fd-2ac6-4558-840a-33219f651cf9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28092024-12-13T21:02:44.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 558fb1fd-2ac6-4558-840a-33219f651cf9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28102024-12-13T21:02:44.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 558fb1fd-2ac6-4558-840a-33219f651cf9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28112024-12-13T21:02:45.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26147337-4f19-4ca1-84fd-753fe97aeb36 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28122024-12-13T21:02:45.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26147337-4f19-4ca1-84fd-753fe97aeb36 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28132024-12-13T21:02:45.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26147337-4f19-4ca1-84fd-753fe97aeb36 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28142024-12-13T21:02:46.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 975bdea7-e5e2-4730-a53d-b464723f7827 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28152024-12-13T21:02:46.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 975bdea7-e5e2-4730-a53d-b464723f7827 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28162024-12-13T21:02:46.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 975bdea7-e5e2-4730-a53d-b464723f7827 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28172024-12-13T21:02:47.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = b96174a2-1b33-4e2e-9b39-794dad12587b response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
28182024-12-13T21:02:47.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
28192024-12-13T21:02:47.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28202024-12-13T21:02:47.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
28212024-12-13T21:02:47.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28222024-12-13T21:02:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28232024-12-13T21:02:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28242024-12-13T21:02:47.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28252024-12-13T21:02:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28262024-12-13T21:02:47.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28272024-12-13T21:02:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28282024-12-13T21:02:47.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28292024-12-13T21:02:47.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28302024-12-13T21:02:47.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28312024-12-13T21:02:47.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28322024-12-13T21:02:47.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28332024-12-13T21:02:47.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
28342024-12-13T21:02:47.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28352024-12-13T21:02:47.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28362024-12-13T21:02:47.776ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
28372024-12-13T21:02:47.776ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.835154ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
28382024-12-13T21:02:47.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.006326ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28392024-12-13T21:02:47.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92387439-e9a0-4c20-a22f-a932fc73fb9c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28402024-12-13T21:02:47.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92387439-e9a0-4c20-a22f-a932fc73fb9c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28412024-12-13T21:02:47.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92387439-e9a0-4c20-a22f-a932fc73fb9c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28422024-12-13T21:02:48.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4d1a6f66-9851-4da6-b98e-15d60e6d932b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28432024-12-13T21:02:48.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4d1a6f66-9851-4da6-b98e-15d60e6d932b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28442024-12-13T21:02:48.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4d1a6f66-9851-4da6-b98e-15d60e6d932b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28452024-12-13T21:02:49.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b4b41c22-305e-40e0-81f1-3cc5f08319c6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28462024-12-13T21:02:49.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b4b41c22-305e-40e0-81f1-3cc5f08319c6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28472024-12-13T21:02:49.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b4b41c22-305e-40e0-81f1-3cc5f08319c6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28482024-12-13T21:02:50.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff181f10-75b7-415f-854c-1988ca91e4db roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28492024-12-13T21:02:50.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff181f10-75b7-415f-854c-1988ca91e4db resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28502024-12-13T21:02:50.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff181f10-75b7-415f-854c-1988ca91e4db response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28512024-12-13T21:02:51.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 452beba5-aa1c-495a-800f-2adfc6578186 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28522024-12-13T21:02:51.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 452beba5-aa1c-495a-800f-2adfc6578186 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28532024-12-13T21:02:51.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 452beba5-aa1c-495a-800f-2adfc6578186 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28542024-12-13T21:02:52.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d55927b-9f09-44c1-b5be-e7aa79591060 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28552024-12-13T21:02:52.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d55927b-9f09-44c1-b5be-e7aa79591060 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28562024-12-13T21:02:52.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d55927b-9f09-44c1-b5be-e7aa79591060 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28572024-12-13T21:02:53.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6a4d62e-42d4-46ea-bfd6-0126b8f92e02 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28582024-12-13T21:02:53.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6a4d62e-42d4-46ea-bfd6-0126b8f92e02 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28592024-12-13T21:02:53.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6a4d62e-42d4-46ea-bfd6-0126b8f92e02 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28602024-12-13T21:02:54.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8cfd932-8549-4be6-9e34-968dee7ffb76 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28612024-12-13T21:02:54.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8cfd932-8549-4be6-9e34-968dee7ffb76 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28622024-12-13T21:02:54.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8cfd932-8549-4be6-9e34-968dee7ffb76 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28632024-12-13T21:02:55.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d59bda54-fcb4-418e-9ae2-18fecce69af6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28642024-12-13T21:02:55.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d59bda54-fcb4-418e-9ae2-18fecce69af6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28652024-12-13T21:02:55.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d59bda54-fcb4-418e-9ae2-18fecce69af6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28662024-12-13T21:02:56.898ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:53143
28672024-12-13T21:02:56.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53143 req_id = c1c5924d-a8d0-4c6f-910f-5937d6c5ebf2 roles = RoleSet { roles: {} } uri = /metrics/producers
28682024-12-13T21:02:56.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53143 req_id = c1c5924d-a8d0-4c6f-910f-5937d6c5ebf2 resource = Database result = Ok(()) uri = /metrics/producers
28692024-12-13T21:02:56.907ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 80dcafa7-ddfc-4f6b-a596-bd2a7d203daf
28702024-12-13T21:02:56.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9412 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53143 req_id = c1c5924d-a8d0-4c6f-910f-5937d6c5ebf2 response_code = 201 uri = /metrics/producers
28712024-12-13T21:02:57.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6cf63645-795c-4120-aca6-a84603a00598 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28722024-12-13T21:02:57.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6cf63645-795c-4120-aca6-a84603a00598 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28732024-12-13T21:02:57.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6cf63645-795c-4120-aca6-a84603a00598 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28742024-12-13T21:02:57.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1668 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 11b05105-cbd3-4c12-8198-a904395c2bcb response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
28752024-12-13T21:02:57.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
28762024-12-13T21:02:57.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28772024-12-13T21:02:57.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
28782024-12-13T21:02:57.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28792024-12-13T21:02:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28802024-12-13T21:02:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28812024-12-13T21:02:57.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28822024-12-13T21:02:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28832024-12-13T21:02:57.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28842024-12-13T21:02:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28852024-12-13T21:02:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28862024-12-13T21:02:57.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28872024-12-13T21:02:57.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28882024-12-13T21:02:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
28892024-12-13T21:02:57.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28902024-12-13T21:02:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28912024-12-13T21:02:57.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
28922024-12-13T21:02:57.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.143495ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
28932024-12-13T21:02:57.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28942024-12-13T21:02:57.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28952024-12-13T21:02:57.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.195715ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28962024-12-13T21:02:58.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 45c7f565-c648-4077-8d0b-ce3c2fb8b13b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28972024-12-13T21:02:58.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 45c7f565-c648-4077-8d0b-ce3c2fb8b13b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28982024-12-13T21:02:58.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 45c7f565-c648-4077-8d0b-ce3c2fb8b13b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
28992024-12-13T21:02:59.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b9e31baa-f82b-4cea-b960-9f22ef9f63a6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29002024-12-13T21:02:59.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b9e31baa-f82b-4cea-b960-9f22ef9f63a6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29012024-12-13T21:02:59.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b9e31baa-f82b-4cea-b960-9f22ef9f63a6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29022024-12-13T21:03:00.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 713a3e1d-712e-499d-841a-e421d55012ad roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29032024-12-13T21:03:00.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 713a3e1d-712e-499d-841a-e421d55012ad resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29042024-12-13T21:03:00.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 713a3e1d-712e-499d-841a-e421d55012ad response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29052024-12-13T21:03:01.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6092a034-d312-436c-933c-0f72b60f4f85 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29062024-12-13T21:03:01.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6092a034-d312-436c-933c-0f72b60f4f85 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29072024-12-13T21:03:01.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6092a034-d312-436c-933c-0f72b60f4f85 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29082024-12-13T21:03:02.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd077f3b-d4f9-4a72-890c-cceb425fa0a0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29092024-12-13T21:03:02.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd077f3b-d4f9-4a72-890c-cceb425fa0a0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29102024-12-13T21:03:02.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd077f3b-d4f9-4a72-890c-cceb425fa0a0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29112024-12-13T21:03:02.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 6f421f36-c946-478e-9564-f1c938b2d1ed roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
29122024-12-13T21:03:02.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 6f421f36-c946-478e-9564-f1c938b2d1ed resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
29132024-12-13T21:03:02.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 6f421f36-c946-478e-9564-f1c938b2d1ed response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
29142024-12-13T21:03:02.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c2642bf3-e13b-45a3-b36d-0f5582b2471e roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
29152024-12-13T21:03:02.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c2642bf3-e13b-45a3-b36d-0f5582b2471e resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
29162024-12-13T21:03:02.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c2642bf3-e13b-45a3-b36d-0f5582b2471e response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
29172024-12-13T21:03:03.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0bd54434-628b-4ec8-83cb-453071628a41 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29182024-12-13T21:03:03.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0bd54434-628b-4ec8-83cb-453071628a41 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29192024-12-13T21:03:03.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0bd54434-628b-4ec8-83cb-453071628a41 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29202024-12-13T21:03:04.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6584b21e-813f-4905-8274-e66c187068c0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29212024-12-13T21:03:04.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6584b21e-813f-4905-8274-e66c187068c0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29222024-12-13T21:03:04.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6584b21e-813f-4905-8274-e66c187068c0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29232024-12-13T21:03:05.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 74774eb0-053f-4f94-8d7b-580e6f9c8df9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29242024-12-13T21:03:05.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 74774eb0-053f-4f94-8d7b-580e6f9c8df9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29252024-12-13T21:03:05.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 74774eb0-053f-4f94-8d7b-580e6f9c8df9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29262024-12-13T21:03:06.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 884f6b94-bb67-4c4b-b5c9-91beca5c94b9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29272024-12-13T21:03:06.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 884f6b94-bb67-4c4b-b5c9-91beca5c94b9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29282024-12-13T21:03:06.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 884f6b94-bb67-4c4b-b5c9-91beca5c94b9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29292024-12-13T21:03:07.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b30955fd-ddf8-4745-87a6-6c262e00fa11 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29302024-12-13T21:03:07.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b30955fd-ddf8-4745-87a6-6c262e00fa11 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29312024-12-13T21:03:07.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b30955fd-ddf8-4745-87a6-6c262e00fa11 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
29322024-12-13T21:03:07.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1518 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 9dbaf6f1-8bc7-4ca3-85f3-fb80264cf6a3 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
29332024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
29342024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29352024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
29362024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
29372024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29382024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
29392024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29402024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29412024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
29422024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
29432024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29442024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29452024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
29462024-12-13T21:03:07.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29472024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
29482024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29492024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29502024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29512024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
29522024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
29532024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29542024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
29552024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29562024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
29572024-12-13T21:03:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
29582024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29592024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29602024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29612024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29622024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29632024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29642024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29652024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29662024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29672024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29682024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29692024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29702024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29712024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29722024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
29732024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
29742024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29752024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29762024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
29772024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29782024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
29792024-12-13T21:03:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29802024-12-13T21:03:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29812024-12-13T21:03:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29822024-12-13T21:03:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29832024-12-13T21:03:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29842024-12-13T21:03:07.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-12-13T21:03:07.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-12-13T21:03:07.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.319983ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29872024-12-13T21:03:07.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1229, tv_nsec: 242411031 } })
29882024-12-13T21:03:07.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29892024-12-13T21:03:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29902024-12-13T21:03:07.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29912024-12-13T21:03:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29922024-12-13T21:03:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29932024-12-13T21:03:07.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29942024-12-13T21:03:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29952024-12-13T21:03:07.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29962024-12-13T21:03:07.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1229, tv_nsec: 245788789 } })
29972024-12-13T21:03:07.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29982024-12-13T21:03:07.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29992024-12-13T21:03:07.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30002024-12-13T21:03:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30012024-12-13T21:03:07.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30022024-12-13T21:03:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30032024-12-13T21:03:07.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30042024-12-13T21:03:07.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30052024-12-13T21:03:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30062024-12-13T21:03:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30072024-12-13T21:03:07.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30082024-12-13T21:03:07.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
30092024-12-13T21:03:07.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30102024-12-13T21:03:07.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30112024-12-13T21:03:07.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122024-12-13T21:03:07.766ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30132024-12-13T21:03:07.766ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30142024-12-13T21:03:07.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30152024-12-13T21:03:07.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30162024-12-13T21:03:07.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30172024-12-13T21:03:07.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30182024-12-13T21:03:07.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30192024-12-13T21:03:07.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30202024-12-13T21:03:07.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30212024-12-13T21:03:07.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222024-12-13T21:03:07.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30232024-12-13T21:03:07.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30242024-12-13T21:03:07.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30252024-12-13T21:03:07.773ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
30262024-12-13T21:03:07.773ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.95424ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
30272024-12-13T21:03:07.774ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30282024-12-13T21:03:07.774ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30292024-12-13T21:03:07.774ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20513cdf-c36d-40ff-ad2c-97342bda7d85", "content-length": "26", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
30302024-12-13T21:03:07.774ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30312024-12-13T21:03:07.776ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30322024-12-13T21:03:07.776ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30332024-12-13T21:03:07.776ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1229, tv_nsec: 289693868 } })
30342024-12-13T21:03:07.776ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b4175b2-991c-4826-97d4-12bf6b550214", "content-length": "26", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
30352024-12-13T21:03:07.776ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30362024-12-13T21:03:07.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
30372024-12-13T21:03:07.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30382024-12-13T21:03:07.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30392024-12-13T21:03:07.778ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30402024-12-13T21:03:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30412024-12-13T21:03:07.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30422024-12-13T21:03:07.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30432024-12-13T21:03:07.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30442024-12-13T21:03:07.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30452024-12-13T21:03:07.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30462024-12-13T21:03:07.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.589864ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30472024-12-13T21:03:07.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.127248ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
30482024-12-13T21:03:07.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30492024-12-13T21:03:07.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30502024-12-13T21:03:07.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30512024-12-13T21:03:07.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.892509ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
30522024-12-13T21:03:07.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30532024-12-13T21:03:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30542024-12-13T21:03:07.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30552024-12-13T21:03:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30562024-12-13T21:03:07.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30572024-12-13T21:03:07.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30582024-12-13T21:03:07.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.131773ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30592024-12-13T21:03:07.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602024-12-13T21:03:07.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30612024-12-13T21:03:07.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30622024-12-13T21:03:07.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30632024-12-13T21:03:07.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30642024-12-13T21:03:07.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30652024-12-13T21:03:07.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30662024-12-13T21:03:07.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30672024-12-13T21:03:07.800ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30682024-12-13T21:03:07.800ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30692024-12-13T21:03:07.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30702024-12-13T21:03:07.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30712024-12-13T21:03:07.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.289485ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30722024-12-13T21:03:07.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30732024-12-13T21:03:07.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
30742024-12-13T21:03:07.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30752024-12-13T21:03:07.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30762024-12-13T21:03:07.815ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30772024-12-13T21:03:07.815ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.423296ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30782024-12-13T21:03:07.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.634875ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30792024-12-13T21:03:07.831ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30802024-12-13T21:03:07.831ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30812024-12-13T21:03:07.831ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.628386ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30822024-12-13T21:03:07.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30832024-12-13T21:03:07.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30842024-12-13T21:03:07.878ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 153.729558ms iteration = 12 status = {}
30852024-12-13T21:03:07.886ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.493949ms iteration = 15 status = {"physical_disks_added":0}
30862024-12-13T21:03:07.892ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30872024-12-13T21:03:07.892ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30882024-12-13T21:03:07.893ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f71e006-9bad-468e-8992-53fc402e4b13", "content-length": "372", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
30892024-12-13T21:03:07.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30902024-12-13T21:03:07.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30912024-12-13T21:03:07.899ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 174.929717ms iteration = 12 status = 0
30922024-12-13T21:03:07.915ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30932024-12-13T21:03:07.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30942024-12-13T21:03:07.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a094ae0a-4f09-438d-a298-a4b6eff6c492", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
30952024-12-13T21:03:07.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30962024-12-13T21:03:07.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30972024-12-13T21:03:07.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30982024-12-13T21:03:07.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30992024-12-13T21:03:07.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31002024-12-13T21:03:07.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31012024-12-13T21:03:07.925ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31022024-12-13T21:03:07.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31032024-12-13T21:03:07.929ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8f07d943-b763-4d9c-8069-4f01d3cc82e4", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31042024-12-13T21:03:07.931ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 206.302051ms iteration = 13 status = {}
31052024-12-13T21:03:07.955ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31062024-12-13T21:03:07.956ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "989fa313-6b49-48e7-a40a-245337f76574", "content-length": "1", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31072024-12-13T21:03:07.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
31082024-12-13T21:03:07.956ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31092024-12-13T21:03:07.956ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9b56e06-803e-4507-9817-24d6f1b3dc2b", "content-length": "26", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31102024-12-13T21:03:07.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31112024-12-13T21:03:07.958ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31122024-12-13T21:03:07.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31132024-12-13T21:03:07.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
31142024-12-13T21:03:07.966ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 241.481353ms iteration = 12 status = null
31152024-12-13T21:03:08.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31162024-12-13T21:03:08.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31172024-12-13T21:03:08.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31182024-12-13T21:03:08.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31192024-12-13T21:03:08.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31202024-12-13T21:03:08.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31212024-12-13T21:03:08.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-12-13T21:03:08.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31232024-12-13T21:03:08.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31242024-12-13T21:03:08.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31252024-12-13T21:03:08.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31262024-12-13T21:03:08.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31272024-12-13T21:03:08.058ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
31282024-12-13T21:03:08.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31292024-12-13T21:03:08.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31302024-12-13T21:03:08.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31312024-12-13T21:03:08.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a80fa5c-56dd-4caf-99ca-986d0cba98a2", "content-length": "134", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31322024-12-13T21:03:08.068ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31332024-12-13T21:03:08.068ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
31342024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31352024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31362024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31372024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31382024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31392024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31402024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31412024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31422024-12-13T21:03:08.069ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
31432024-12-13T21:03:08.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31442024-12-13T21:03:08.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31452024-12-13T21:03:08.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31462024-12-13T21:03:08.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4f1e49f-eca2-4206-a763-229458f93b66", "content-length": "691", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31472024-12-13T21:03:08.085ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31482024-12-13T21:03:08.085ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31492024-12-13T21:03:08.085ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31502024-12-13T21:03:08.086ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 361.428285ms iteration = 12 status = {}
31512024-12-13T21:03:08.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31522024-12-13T21:03:08.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d93bdb6a-b5b0-4a19-ab33-bb49cffe4227", "content-length": "2", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31532024-12-13T21:03:08.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31542024-12-13T21:03:08.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b777225-532c-421c-8be6-25c322de37cf", "content-length": "52", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31552024-12-13T21:03:08.087ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
31562024-12-13T21:03:08.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31572024-12-13T21:03:08.176ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "383c8738-d39a-4e97-9955-10e2e2bf2690", "date": "Fri, 13 Dec 2024 21:03:07 GMT"} })
31582024-12-13T21:03:08.176ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
31592024-12-13T21:03:08.176ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31602024-12-13T21:03:08.177ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a66c0806-0770-473d-8c91-691a96b20940", "content-length": "682", "date": "Fri, 13 Dec 2024 21:03:08 GMT"} })
31612024-12-13T21:03:08.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31622024-12-13T21:03:08.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31632024-12-13T21:03:08.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31642024-12-13T21:03:08.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31652024-12-13T21:03:08.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31662024-12-13T21:03:08.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31672024-12-13T21:03:08.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31682024-12-13T21:03:08.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31692024-12-13T21:03:08.199ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 474.452387ms iteration = 12 status = {}
31702024-12-13T21:03:08.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3a58d0b5-657b-4f09-87ce-16a071e7bf12 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31712024-12-13T21:03:08.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3a58d0b5-657b-4f09-87ce-16a071e7bf12 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31722024-12-13T21:03:08.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3a58d0b5-657b-4f09-87ce-16a071e7bf12 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31732024-12-13T21:03:09.045ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31742024-12-13T21:03:09.045ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
31752024-12-13T21:03:09.075ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
31762024-12-13T21:03:09.076ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62660
31772024-12-13T21:03:09.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62660 req_id = 65dbb25d-9ab6-4793-8128-75b4763350e0 roles = RoleSet { roles: {} } uri = /metrics/producers
31782024-12-13T21:03:09.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62660 req_id = 65dbb25d-9ab6-4793-8128-75b4763350e0 resource = Database result = Ok(()) uri = /metrics/producers
31792024-12-13T21:03:09.108ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 0599e804-8800-4951-9d87-7a8a49a507a3
31802024-12-13T21:03:09.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32102 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62660 req_id = 65dbb25d-9ab6-4793-8128-75b4763350e0 response_code = 201 uri = /metrics/producers
31812024-12-13T21:03:09.108ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "65dbb25d-9ab6-4793-8128-75b4763350e0", "content-length": "41", "date": "Fri, 13 Dec 2024 21:03:09 GMT"} })
31822024-12-13T21:03:09.108ZDEBGnexus (producer-registration-task): registered with nexus successfully
31832024-12-13T21:03:09.109ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31842024-12-13T21:03:09.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = df43c6c5-73d4-49e0-9ef9-283e100e6f2b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31852024-12-13T21:03:09.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = df43c6c5-73d4-49e0-9ef9-283e100e6f2b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31862024-12-13T21:03:09.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = df43c6c5-73d4-49e0-9ef9-283e100e6f2b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31872024-12-13T21:03:09.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = acbed645-3835-4b9b-a98e-91da078d23fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31882024-12-13T21:03:09.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = acbed645-3835-4b9b-a98e-91da078d23fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31892024-12-13T21:03:09.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = acbed645-3835-4b9b-a98e-91da078d23fe response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31902024-12-13T21:03:10.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c94d09f-eb99-4add-ac23-fadee6fac975 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31912024-12-13T21:03:10.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c94d09f-eb99-4add-ac23-fadee6fac975 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31922024-12-13T21:03:10.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c94d09f-eb99-4add-ac23-fadee6fac975 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31932024-12-13T21:03:11.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f5c541e5-927f-4df9-9557-a7c5f3929b08 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31942024-12-13T21:03:11.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f5c541e5-927f-4df9-9557-a7c5f3929b08 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31952024-12-13T21:03:11.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f5c541e5-927f-4df9-9557-a7c5f3929b08 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31962024-12-13T21:03:12.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8881a93-bf83-43ec-8d33-fc079490d266 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31972024-12-13T21:03:12.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8881a93-bf83-43ec-8d33-fc079490d266 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31982024-12-13T21:03:12.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8881a93-bf83-43ec-8d33-fc079490d266 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
31992024-12-13T21:03:13.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2dcc13e2-9b9c-4556-858a-b0990b3a1673 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32002024-12-13T21:03:13.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2dcc13e2-9b9c-4556-858a-b0990b3a1673 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32012024-12-13T21:03:13.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2dcc13e2-9b9c-4556-858a-b0990b3a1673 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32022024-12-13T21:03:14.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b127f93-aacb-4e3e-8a27-aab936e284b4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32032024-12-13T21:03:14.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b127f93-aacb-4e3e-8a27-aab936e284b4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32042024-12-13T21:03:14.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b127f93-aacb-4e3e-8a27-aab936e284b4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32052024-12-13T21:03:15.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4292696-05b0-4fa2-b827-1ddd1701cdd3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32062024-12-13T21:03:15.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4292696-05b0-4fa2-b827-1ddd1701cdd3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32072024-12-13T21:03:15.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4292696-05b0-4fa2-b827-1ddd1701cdd3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32082024-12-13T21:03:16.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aed1c2a6-85a2-44e1-9388-6be38efd706d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32092024-12-13T21:03:16.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aed1c2a6-85a2-44e1-9388-6be38efd706d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32102024-12-13T21:03:16.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aed1c2a6-85a2-44e1-9388-6be38efd706d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32112024-12-13T21:03:17.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 072414ab-f150-42a8-956b-1a05d1094c01 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32122024-12-13T21:03:17.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 072414ab-f150-42a8-956b-1a05d1094c01 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32132024-12-13T21:03:17.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 072414ab-f150-42a8-956b-1a05d1094c01 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32142024-12-13T21:03:17.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1499 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = b8b40768-6def-40e1-81fe-630fab121692 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
32152024-12-13T21:03:17.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
32162024-12-13T21:03:17.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
32172024-12-13T21:03:17.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32182024-12-13T21:03:17.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32192024-12-13T21:03:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32202024-12-13T21:03:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32212024-12-13T21:03:17.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32222024-12-13T21:03:17.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32232024-12-13T21:03:17.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32242024-12-13T21:03:17.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32252024-12-13T21:03:17.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32262024-12-13T21:03:17.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32272024-12-13T21:03:17.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32282024-12-13T21:03:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32292024-12-13T21:03:17.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.248188ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32302024-12-13T21:03:17.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32312024-12-13T21:03:17.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
32322024-12-13T21:03:17.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32332024-12-13T21:03:17.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32342024-12-13T21:03:17.799ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
32352024-12-13T21:03:17.799ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.371749ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
32362024-12-13T21:03:18.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dc79f14a-95f6-4751-a6b0-92940b5925c0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32372024-12-13T21:03:18.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dc79f14a-95f6-4751-a6b0-92940b5925c0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32382024-12-13T21:03:18.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dc79f14a-95f6-4751-a6b0-92940b5925c0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32392024-12-13T21:03:19.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22e626e8-b2eb-486f-b91d-61a018b9e6d4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32402024-12-13T21:03:19.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22e626e8-b2eb-486f-b91d-61a018b9e6d4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32412024-12-13T21:03:19.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22e626e8-b2eb-486f-b91d-61a018b9e6d4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32422024-12-13T21:03:20.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69b64dcf-04c6-4394-a5ce-b2bef33045bd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32432024-12-13T21:03:20.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69b64dcf-04c6-4394-a5ce-b2bef33045bd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32442024-12-13T21:03:20.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69b64dcf-04c6-4394-a5ce-b2bef33045bd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32452024-12-13T21:03:21.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 436ef990-a5d3-4589-b393-3fd5ea297048 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32462024-12-13T21:03:21.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 436ef990-a5d3-4589-b393-3fd5ea297048 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32472024-12-13T21:03:21.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 436ef990-a5d3-4589-b393-3fd5ea297048 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32482024-12-13T21:03:22.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22151983-a1a8-4953-acb8-6ac13c015340 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32492024-12-13T21:03:22.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22151983-a1a8-4953-acb8-6ac13c015340 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32502024-12-13T21:03:22.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22151983-a1a8-4953-acb8-6ac13c015340 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32512024-12-13T21:03:23.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6286c54f-57b0-4e44-ac36-3a2e5f7e15c8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32522024-12-13T21:03:23.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6286c54f-57b0-4e44-ac36-3a2e5f7e15c8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32532024-12-13T21:03:23.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6286c54f-57b0-4e44-ac36-3a2e5f7e15c8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32542024-12-13T21:03:24.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 357e4526-1fec-48bf-a6c0-ae93a69b4365 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32552024-12-13T21:03:24.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 357e4526-1fec-48bf-a6c0-ae93a69b4365 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32562024-12-13T21:03:24.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 357e4526-1fec-48bf-a6c0-ae93a69b4365 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32572024-12-13T21:03:25.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77d64c81-4726-4ccf-8fc3-fb9d2d39a84d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32582024-12-13T21:03:25.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77d64c81-4726-4ccf-8fc3-fb9d2d39a84d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32592024-12-13T21:03:25.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77d64c81-4726-4ccf-8fc3-fb9d2d39a84d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32602024-12-13T21:03:26.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1433cb73-4a4e-41f1-9d80-1fdc98e0ba74 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32612024-12-13T21:03:26.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1433cb73-4a4e-41f1-9d80-1fdc98e0ba74 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32622024-12-13T21:03:26.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1433cb73-4a4e-41f1-9d80-1fdc98e0ba74 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32632024-12-13T21:03:27.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 44ba29c8-edcd-4cf8-a926-40bd1fc3c326 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32642024-12-13T21:03:27.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 44ba29c8-edcd-4cf8-a926-40bd1fc3c326 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32652024-12-13T21:03:27.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 44ba29c8-edcd-4cf8-a926-40bd1fc3c326 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32662024-12-13T21:03:27.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 88c09a18-51de-41c1-9106-51cdcda4b2c8 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
32672024-12-13T21:03:27.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
32682024-12-13T21:03:27.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32692024-12-13T21:03:27.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
32702024-12-13T21:03:27.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32712024-12-13T21:03:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32722024-12-13T21:03:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32732024-12-13T21:03:27.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32742024-12-13T21:03:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32752024-12-13T21:03:27.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32762024-12-13T21:03:27.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.167372ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32772024-12-13T21:03:27.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32782024-12-13T21:03:27.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32792024-12-13T21:03:27.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32802024-12-13T21:03:27.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32812024-12-13T21:03:27.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32822024-12-13T21:03:27.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32832024-12-13T21:03:27.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
32842024-12-13T21:03:27.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32852024-12-13T21:03:27.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32862024-12-13T21:03:27.775ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
32872024-12-13T21:03:27.775ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.6378ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
32882024-12-13T21:03:28.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e3f208a1-693b-4eaa-84ee-a16f2ad50911 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32892024-12-13T21:03:28.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e3f208a1-693b-4eaa-84ee-a16f2ad50911 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32902024-12-13T21:03:28.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e3f208a1-693b-4eaa-84ee-a16f2ad50911 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32912024-12-13T21:03:29.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5e368b03-3304-4b8e-bfb8-f564bb2ebe1f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32922024-12-13T21:03:29.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5e368b03-3304-4b8e-bfb8-f564bb2ebe1f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32932024-12-13T21:03:29.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5e368b03-3304-4b8e-bfb8-f564bb2ebe1f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32942024-12-13T21:03:30.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 61278a6e-ea76-4f07-8233-eaf38812cb1e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32952024-12-13T21:03:30.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 61278a6e-ea76-4f07-8233-eaf38812cb1e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32962024-12-13T21:03:30.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 61278a6e-ea76-4f07-8233-eaf38812cb1e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32972024-12-13T21:03:31.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f3c1f9f-8ecd-4888-88fb-5222dfefc76b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32982024-12-13T21:03:31.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f3c1f9f-8ecd-4888-88fb-5222dfefc76b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
32992024-12-13T21:03:31.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f3c1f9f-8ecd-4888-88fb-5222dfefc76b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33002024-12-13T21:03:32.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5e29de93-8278-42ae-bd5d-ef52e0c83da1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33012024-12-13T21:03:32.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5e29de93-8278-42ae-bd5d-ef52e0c83da1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33022024-12-13T21:03:32.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5e29de93-8278-42ae-bd5d-ef52e0c83da1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33032024-12-13T21:03:33.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 52c3818f-bf31-4440-8b86-d8455d28e4be roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33042024-12-13T21:03:33.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 52c3818f-bf31-4440-8b86-d8455d28e4be resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33052024-12-13T21:03:33.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 52c3818f-bf31-4440-8b86-d8455d28e4be response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33062024-12-13T21:03:34.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa82bb26-c374-4a1c-86db-7d0692c00e0c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33072024-12-13T21:03:34.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa82bb26-c374-4a1c-86db-7d0692c00e0c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33082024-12-13T21:03:34.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa82bb26-c374-4a1c-86db-7d0692c00e0c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33092024-12-13T21:03:35.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0ebd4c6a-8640-4509-a787-d8ebcdf9360e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33102024-12-13T21:03:35.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0ebd4c6a-8640-4509-a787-d8ebcdf9360e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33112024-12-13T21:03:35.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0ebd4c6a-8640-4509-a787-d8ebcdf9360e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33122024-12-13T21:03:36.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3e97b19d-111e-430a-aae4-c041e432cd4b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33132024-12-13T21:03:36.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3e97b19d-111e-430a-aae4-c041e432cd4b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33142024-12-13T21:03:36.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3e97b19d-111e-430a-aae4-c041e432cd4b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
33152024-12-13T21:03:37.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1538 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 259e4080-4d01-424a-aa11-eb0c301760e1 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
33162024-12-13T21:03:37.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
33172024-12-13T21:03:37.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33182024-12-13T21:03:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
33192024-12-13T21:03:37.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
33202024-12-13T21:03:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
33212024-12-13T21:03:37.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33222024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33232024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
33242024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
33252024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33262024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33272024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
33282024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
33292024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33302024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
33312024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33322024-12-13T21:03:37.724ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33332024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33342024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
33352024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
33362024-12-13T21:03:37.724ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
33372024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
33382024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.241\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
33392024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
33402024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
33412024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33422024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
33432024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33442024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33452024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33462024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
33472024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
33482024-12-13T21:03:37.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33492024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
33502024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33512024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33522024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
33532024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
33542024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33552024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
33562024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
33572024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33582024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33592024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33602024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
33612024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33622024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33632024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
33642024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33652024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
33662024-12-13T21:03:37.724ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:53:37.724323508 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33672024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33682024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33692024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33702024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33712024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33722024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33732024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33742024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33752024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33762024-12-13T21:03:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
33772024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
33782024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33792024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
33802024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33812024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33822024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33832024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
33842024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33852024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
33862024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
33872024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33882024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33892024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33902024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33912024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33922024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33932024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33942024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33952024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33962024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33972024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33982024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33992024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34002024-12-13T21:03:37.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 238227595 } })
34012024-12-13T21:03:37.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 238245346 } })
34022024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34032024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34042024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34052024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34062024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34072024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34082024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34092024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34102024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34112024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
34122024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34132024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.720425ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
34142024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
34152024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.617002ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
34162024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34172024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34182024-12-13T21:03:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34192024-12-13T21:03:37.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202024-12-13T21:03:37.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34212024-12-13T21:03:37.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34222024-12-13T21:03:37.728ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.545088ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34232024-12-13T21:03:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34242024-12-13T21:03:37.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34252024-12-13T21:03:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34262024-12-13T21:03:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34272024-12-13T21:03:37.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34282024-12-13T21:03:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34292024-12-13T21:03:37.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-12-13T21:03:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34312024-12-13T21:03:37.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34322024-12-13T21:03:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34332024-12-13T21:03:37.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 246069789 } })
34342024-12-13T21:03:37.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
34352024-12-13T21:03:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34362024-12-13T21:03:37.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34372024-12-13T21:03:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34382024-12-13T21:03:37.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34392024-12-13T21:03:37.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34402024-12-13T21:03:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34412024-12-13T21:03:37.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 248615404 } })
34422024-12-13T21:03:37.735ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
34432024-12-13T21:03:37.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34442024-12-13T21:03:37.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34452024-12-13T21:03:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34462024-12-13T21:03:37.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34472024-12-13T21:03:37.737ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:53:37.724323508 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34482024-12-13T21:03:37.737ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.248674ms iteration = 7 status = {"expiration":"2024-12-13T20:53:37.724323508Z","pruned":[]}
34492024-12-13T21:03:37.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34502024-12-13T21:03:37.738ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34512024-12-13T21:03:37.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-12-13T21:03:37.739ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.872606ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
34532024-12-13T21:03:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34542024-12-13T21:03:37.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34552024-12-13T21:03:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34562024-12-13T21:03:37.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34572024-12-13T21:03:37.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34582024-12-13T21:03:37.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34592024-12-13T21:03:37.742ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602024-12-13T21:03:37.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34612024-12-13T21:03:37.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34622024-12-13T21:03:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34632024-12-13T21:03:37.745ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34642024-12-13T21:03:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34652024-12-13T21:03:37.746ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662024-12-13T21:03:37.746ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 259783994 } })
34672024-12-13T21:03:37.746ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
34682024-12-13T21:03:37.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34692024-12-13T21:03:37.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34702024-12-13T21:03:37.748ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34712024-12-13T21:03:37.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34722024-12-13T21:03:37.748ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34732024-12-13T21:03:37.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34742024-12-13T21:03:37.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34752024-12-13T21:03:37.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34762024-12-13T21:03:37.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34772024-12-13T21:03:37.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34782024-12-13T21:03:37.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34792024-12-13T21:03:37.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34802024-12-13T21:03:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34812024-12-13T21:03:37.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34822024-12-13T21:03:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34832024-12-13T21:03:37.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34842024-12-13T21:03:37.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34852024-12-13T21:03:37.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34862024-12-13T21:03:37.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872024-12-13T21:03:37.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34882024-12-13T21:03:37.766ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34892024-12-13T21:03:37.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34902024-12-13T21:03:37.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34912024-12-13T21:03:37.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34922024-12-13T21:03:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34932024-12-13T21:03:37.768ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34942024-12-13T21:03:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34952024-12-13T21:03:37.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34962024-12-13T21:03:37.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34972024-12-13T21:03:37.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34982024-12-13T21:03:37.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34992024-12-13T21:03:37.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35002024-12-13T21:03:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35012024-12-13T21:03:37.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35022024-12-13T21:03:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35032024-12-13T21:03:37.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.218162ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35042024-12-13T21:03:37.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.367602ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
35052024-12-13T21:03:37.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35062024-12-13T21:03:37.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35072024-12-13T21:03:37.786ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35082024-12-13T21:03:37.786ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35092024-12-13T21:03:37.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35102024-12-13T21:03:37.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35112024-12-13T21:03:37.787ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35122024-12-13T21:03:37.787ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35132024-12-13T21:03:37.787ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.975848ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35142024-12-13T21:03:37.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35152024-12-13T21:03:37.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.132437ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
35162024-12-13T21:03:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35172024-12-13T21:03:37.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35182024-12-13T21:03:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35192024-12-13T21:03:37.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35202024-12-13T21:03:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35212024-12-13T21:03:37.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35222024-12-13T21:03:37.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35232024-12-13T21:03:37.792ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35242024-12-13T21:03:37.792ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35252024-12-13T21:03:37.792ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35262024-12-13T21:03:37.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35272024-12-13T21:03:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35282024-12-13T21:03:37.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35292024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35302024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35312024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35322024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35332024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35342024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35352024-12-13T21:03:37.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35362024-12-13T21:03:37.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35372024-12-13T21:03:37.799ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35382024-12-13T21:03:37.799ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.475927ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35392024-12-13T21:03:37.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35402024-12-13T21:03:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35412024-12-13T21:03:37.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35422024-12-13T21:03:37.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.567442ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35432024-12-13T21:03:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35442024-12-13T21:03:37.820ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35452024-12-13T21:03:37.820ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35462024-12-13T21:03:37.820ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.127453ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35472024-12-13T21:03:37.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35482024-12-13T21:03:37.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35492024-12-13T21:03:37.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde53922-c4b4-44ee-9eb0-46b74401b39c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
35502024-12-13T21:03:37.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde53922-c4b4-44ee-9eb0-46b74401b39c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
35512024-12-13T21:03:37.861ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35522024-12-13T21:03:37.862ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.949284ms iteration = 16 status = {"physical_disks_added":0}
35532024-12-13T21:03:37.878ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35542024-12-13T21:03:37.885ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35552024-12-13T21:03:37.885ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35562024-12-13T21:03:37.885ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "31b71f01-f12d-4d19-a47f-560afea2be64", "content-length": "26", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
35572024-12-13T21:03:37.885ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35582024-12-13T21:03:37.887ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35592024-12-13T21:03:37.893ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35602024-12-13T21:03:37.893ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35612024-12-13T21:03:37.893ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "190d3776-2f7f-4280-9918-531e322c8c63", "content-length": "26", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
35622024-12-13T21:03:37.893ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35632024-12-13T21:03:37.895ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35642024-12-13T21:03:37.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
35652024-12-13T21:03:37.897ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35662024-12-13T21:03:37.898ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16720f7e-99db-4bda-a54c-f4c25cfcaab5", "content-length": "26", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
35672024-12-13T21:03:37.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35682024-12-13T21:03:37.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
35692024-12-13T21:03:37.992ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35702024-12-13T21:03:37.992ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35712024-12-13T21:03:37.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "de20b133-30c4-446d-8c11-2ed5ea11da97", "content-length": "372", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
35722024-12-13T21:03:37.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35732024-12-13T21:03:37.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35742024-12-13T21:03:38.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35752024-12-13T21:03:38.001ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 277.178929ms iteration = 4 status = {"nsuccess":5}
35762024-12-13T21:03:38.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35772024-12-13T21:03:38.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35782024-12-13T21:03:38.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35792024-12-13T21:03:38.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde53922-c4b4-44ee-9eb0-46b74401b39c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
35802024-12-13T21:03:38.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35812024-12-13T21:03:38.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
35822024-12-13T21:03:38.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35832024-12-13T21:03:38.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35842024-12-13T21:03:38.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
35852024-12-13T21:03:38.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 301.228243ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
35862024-12-13T21:03:38.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35872024-12-13T21:03:38.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35882024-12-13T21:03:38.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892024-12-13T21:03:38.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
35902024-12-13T21:03:38.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35912024-12-13T21:03:38.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35922024-12-13T21:03:38.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 311.435748ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35932024-12-13T21:03:38.037ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 313.316007ms iteration = 13 status = 0
35942024-12-13T21:03:38.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35952024-12-13T21:03:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35962024-12-13T21:03:38.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35972024-12-13T21:03:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35982024-12-13T21:03:38.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992024-12-13T21:03:38.044ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36002024-12-13T21:03:38.044ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36012024-12-13T21:03:38.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36022024-12-13T21:03:38.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36032024-12-13T21:03:38.045ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36042024-12-13T21:03:38.045ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "97f77f1d-0f7e-4b96-a873-d8c44b0fa5ee", "date": "Fri, 13 Dec 2024 21:03:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36052024-12-13T21:03:38.045ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36062024-12-13T21:03:38.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072024-12-13T21:03:38.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36082024-12-13T21:03:38.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36092024-12-13T21:03:38.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36102024-12-13T21:03:38.047ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "428db9e1-cfb3-4af6-bec2-501fdbe00f10", "date": "Fri, 13 Dec 2024 21:03:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36112024-12-13T21:03:38.047ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36122024-12-13T21:03:38.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36132024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36142024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36152024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36162024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
36172024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36182024-12-13T21:03:38.049ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36192024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 325.135253ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36202024-12-13T21:03:38.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36212024-12-13T21:03:38.053ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36222024-12-13T21:03:38.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36232024-12-13T21:03:38.053ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "69ab540c-6f7a-4b02-97aa-1abb409b78d2", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
36242024-12-13T21:03:38.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36252024-12-13T21:03:38.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36262024-12-13T21:03:38.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36272024-12-13T21:03:38.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36282024-12-13T21:03:38.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36292024-12-13T21:03:38.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36302024-12-13T21:03:38.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36312024-12-13T21:03:38.065ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.5916ms iteration = 13 status = {}
36322024-12-13T21:03:38.066ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36332024-12-13T21:03:38.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36342024-12-13T21:03:38.066ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f35e63b6-eb4f-4597-92b6-309b37457894", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
36352024-12-13T21:03:38.068ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.135636ms iteration = 14 status = {}
36362024-12-13T21:03:38.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 349.755472ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36372024-12-13T21:03:38.078ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36382024-12-13T21:03:38.078ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36392024-12-13T21:03:38.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36402024-12-13T21:03:38.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36412024-12-13T21:03:38.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36422024-12-13T21:03:38.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36432024-12-13T21:03:38.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36442024-12-13T21:03:38.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36452024-12-13T21:03:38.083ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36462024-12-13T21:03:38.084ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d857e5d7-29a8-4fc3-bb0f-a26f8588b681", "content-length": "1", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
36472024-12-13T21:03:38.085ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36482024-12-13T21:03:38.085ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36492024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 361.176648ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36502024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36512024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36522024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
36532024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 361.379353ms iteration = 8 status = {"generation":1}
36542024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36552024-12-13T21:03:38.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36562024-12-13T21:03:38.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36572024-12-13T21:03:38.088ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.988921ms iteration = 13 status = null
36582024-12-13T21:03:38.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36592024-12-13T21:03:38.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36602024-12-13T21:03:38.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36612024-12-13T21:03:38.090ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
36622024-12-13T21:03:38.090ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36632024-12-13T21:03:38.090ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
36642024-12-13T21:03:38.090ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 366.217769ms iteration = 8 status = {"generation":2}
36652024-12-13T21:03:38.092ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
36662024-12-13T21:03:38.092ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 368.334724ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36672024-12-13T21:03:38.108ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
36682024-12-13T21:03:38.108ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 384.218886ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36692024-12-13T21:03:38.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36702024-12-13T21:03:38.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36712024-12-13T21:03:38.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-12-13T21:03:38.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36732024-12-13T21:03:38.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36742024-12-13T21:03:38.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36752024-12-13T21:03:38.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36762024-12-13T21:03:38.131ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b4c4e4b0-35a2-4fd2-8d80-1c5d8e426fe4", "date": "Fri, 13 Dec 2024 21:03:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36772024-12-13T21:03:38.131ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36782024-12-13T21:03:38.134ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "501222aa-f26f-42cf-8196-e282e8c5ec3a", "date": "Fri, 13 Dec 2024 21:03:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36792024-12-13T21:03:38.134ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36802024-12-13T21:03:38.135ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0d8c4b5f-b8f5-4058-98be-5eeeabfc5003", "date": "Fri, 13 Dec 2024 21:03:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36812024-12-13T21:03:38.135ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36822024-12-13T21:03:38.137ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36832024-12-13T21:03:38.137ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 413.474524ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36842024-12-13T21:03:38.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36852024-12-13T21:03:38.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36862024-12-13T21:03:38.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36872024-12-13T21:03:38.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36882024-12-13T21:03:38.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36892024-12-13T21:03:38.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36902024-12-13T21:03:38.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
36912024-12-13T21:03:38.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36922024-12-13T21:03:38.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36932024-12-13T21:03:38.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36942024-12-13T21:03:38.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bef253a-5356-438b-a1bb-f0028a46da8d", "content-length": "134", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
36952024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36962024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
36972024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36982024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36992024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37002024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37012024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37022024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37032024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37042024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37052024-12-13T21:03:38.174ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
37062024-12-13T21:03:38.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37072024-12-13T21:03:38.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37082024-12-13T21:03:38.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37092024-12-13T21:03:38.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba3bafce-715f-4cfe-b197-6ecdad7638ab", "content-length": "2", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
37102024-12-13T21:03:38.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37112024-12-13T21:03:38.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac72201-95c2-4911-9b77-ce6d0d194f79", "content-length": "52", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
37122024-12-13T21:03:38.177ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
37132024-12-13T21:03:38.177ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37142024-12-13T21:03:38.235ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37152024-12-13T21:03:38.273ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a079b8c6-5706-4aa8-8924-af8c056ef1e1", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
37162024-12-13T21:03:38.273ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
37172024-12-13T21:03:38.273ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37182024-12-13T21:03:38.273ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cacdf30a-f808-45f7-8ad4-b04ebdfc54e9", "content-length": "691", "date": "Fri, 13 Dec 2024 21:03:37 GMT"} })
37192024-12-13T21:03:38.274ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37202024-12-13T21:03:38.274ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37212024-12-13T21:03:38.274ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37222024-12-13T21:03:38.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "39fc3ffe-e83a-4d18-8cbb-c88b1a1f98a6", "content-length": "682", "date": "Fri, 13 Dec 2024 21:03:38 GMT"} })
37232024-12-13T21:03:38.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37242024-12-13T21:03:38.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37252024-12-13T21:03:38.276ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.279505ms iteration = 13 status = {}
37262024-12-13T21:03:38.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37272024-12-13T21:03:38.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37282024-12-13T21:03:38.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37292024-12-13T21:03:38.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37302024-12-13T21:03:38.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37312024-12-13T21:03:38.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37322024-12-13T21:03:38.291ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 567.729075ms iteration = 13 status = {}
37332024-12-13T21:03:39.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cd929b91-2caf-451a-836b-c71c013df9a1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37342024-12-13T21:03:39.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cd929b91-2caf-451a-836b-c71c013df9a1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37352024-12-13T21:03:39.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cd929b91-2caf-451a-836b-c71c013df9a1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37362024-12-13T21:03:39.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = dbe0f819-8147-437a-9d24-e302a3d6219e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37372024-12-13T21:03:39.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = dbe0f819-8147-437a-9d24-e302a3d6219e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37382024-12-13T21:03:39.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = dbe0f819-8147-437a-9d24-e302a3d6219e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37392024-12-13T21:03:40.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fbf8f0a8-7d48-4082-b4f6-898ac71fded4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37402024-12-13T21:03:40.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fbf8f0a8-7d48-4082-b4f6-898ac71fded4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37412024-12-13T21:03:40.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fbf8f0a8-7d48-4082-b4f6-898ac71fded4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37422024-12-13T21:03:41.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 14cefd2b-b0d9-488f-9a14-c7ffcee5bf4d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37432024-12-13T21:03:41.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 14cefd2b-b0d9-488f-9a14-c7ffcee5bf4d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37442024-12-13T21:03:41.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 14cefd2b-b0d9-488f-9a14-c7ffcee5bf4d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37452024-12-13T21:03:42.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 25864bc8-cd56-4f48-8046-00cc2d5f15bd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37462024-12-13T21:03:42.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 25864bc8-cd56-4f48-8046-00cc2d5f15bd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37472024-12-13T21:03:42.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 25864bc8-cd56-4f48-8046-00cc2d5f15bd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37482024-12-13T21:03:43.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 530bb662-d373-4e9a-81f8-683e74974380 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37492024-12-13T21:03:43.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 530bb662-d373-4e9a-81f8-683e74974380 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37502024-12-13T21:03:43.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 530bb662-d373-4e9a-81f8-683e74974380 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37512024-12-13T21:03:44.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 944442fa-d4e0-442d-924f-b51db1326408 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37522024-12-13T21:03:44.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 944442fa-d4e0-442d-924f-b51db1326408 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37532024-12-13T21:03:44.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 944442fa-d4e0-442d-924f-b51db1326408 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37542024-12-13T21:03:45.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 89d5d855-08eb-401f-be38-d9dc9513a0cb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37552024-12-13T21:03:45.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 89d5d855-08eb-401f-be38-d9dc9513a0cb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37562024-12-13T21:03:45.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 89d5d855-08eb-401f-be38-d9dc9513a0cb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37572024-12-13T21:03:46.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 219c0658-1511-4a48-93a5-c43a8bc92594 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37582024-12-13T21:03:46.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 219c0658-1511-4a48-93a5-c43a8bc92594 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37592024-12-13T21:03:46.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 219c0658-1511-4a48-93a5-c43a8bc92594 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37602024-12-13T21:03:47.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 800849fe-9480-49d0-a702-d7ec73914384 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37612024-12-13T21:03:47.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 800849fe-9480-49d0-a702-d7ec73914384 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37622024-12-13T21:03:47.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 800849fe-9480-49d0-a702-d7ec73914384 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37632024-12-13T21:03:47.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1276 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 7f756da2-74a6-4166-831a-c2450fe34f19 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
37642024-12-13T21:03:47.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
37652024-12-13T21:03:47.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37662024-12-13T21:03:47.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
37672024-12-13T21:03:47.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682024-12-13T21:03:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37692024-12-13T21:03:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37702024-12-13T21:03:47.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712024-12-13T21:03:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37722024-12-13T21:03:47.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37732024-12-13T21:03:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37742024-12-13T21:03:47.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37752024-12-13T21:03:47.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762024-12-13T21:03:47.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772024-12-13T21:03:47.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
37782024-12-13T21:03:47.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37792024-12-13T21:03:47.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37802024-12-13T21:03:47.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
37812024-12-13T21:03:47.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.313269ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
37822024-12-13T21:03:47.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37832024-12-13T21:03:47.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37842024-12-13T21:03:47.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.055428ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37852024-12-13T21:03:48.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3ce72d3-e2d6-434e-b64c-b4862b0dd560 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37862024-12-13T21:03:48.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3ce72d3-e2d6-434e-b64c-b4862b0dd560 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37872024-12-13T21:03:48.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3ce72d3-e2d6-434e-b64c-b4862b0dd560 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37882024-12-13T21:03:49.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1bddb733-44a8-4ac4-b8af-7eeac7a4db96 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37892024-12-13T21:03:49.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1bddb733-44a8-4ac4-b8af-7eeac7a4db96 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37902024-12-13T21:03:49.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1bddb733-44a8-4ac4-b8af-7eeac7a4db96 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37912024-12-13T21:03:50.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 43aaf853-5009-4f8a-952a-664496016d9a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37922024-12-13T21:03:50.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 43aaf853-5009-4f8a-952a-664496016d9a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37932024-12-13T21:03:50.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 43aaf853-5009-4f8a-952a-664496016d9a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37942024-12-13T21:03:51.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fd71e5d-df61-4cb4-97f8-7bacab266743 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37952024-12-13T21:03:51.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fd71e5d-df61-4cb4-97f8-7bacab266743 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37962024-12-13T21:03:51.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fd71e5d-df61-4cb4-97f8-7bacab266743 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37972024-12-13T21:03:52.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 997aba3a-1104-457d-a0c9-0fa9cc6f1e74 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37982024-12-13T21:03:52.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 997aba3a-1104-457d-a0c9-0fa9cc6f1e74 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
37992024-12-13T21:03:52.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 997aba3a-1104-457d-a0c9-0fa9cc6f1e74 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38002024-12-13T21:03:53.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9bdacb33-b1f6-4ef5-ba4f-4d22188dd634 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38012024-12-13T21:03:53.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9bdacb33-b1f6-4ef5-ba4f-4d22188dd634 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38022024-12-13T21:03:53.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9bdacb33-b1f6-4ef5-ba4f-4d22188dd634 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38032024-12-13T21:03:54.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 102e820c-9908-41d9-9cda-2e1c00a234be roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38042024-12-13T21:03:54.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 102e820c-9908-41d9-9cda-2e1c00a234be resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38052024-12-13T21:03:54.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 102e820c-9908-41d9-9cda-2e1c00a234be response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38062024-12-13T21:03:55.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = df688969-6334-4185-b9fd-ea4e92435655 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38072024-12-13T21:03:55.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = df688969-6334-4185-b9fd-ea4e92435655 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38082024-12-13T21:03:55.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = df688969-6334-4185-b9fd-ea4e92435655 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38092024-12-13T21:03:56.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 04106351-f12f-49c8-9aa8-2ba75ea33bc7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38102024-12-13T21:03:56.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 04106351-f12f-49c8-9aa8-2ba75ea33bc7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38112024-12-13T21:03:56.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 04106351-f12f-49c8-9aa8-2ba75ea33bc7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38122024-12-13T21:03:57.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 98d8b737-15c3-4468-97f0-e07f16eabb80 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38132024-12-13T21:03:57.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 98d8b737-15c3-4468-97f0-e07f16eabb80 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38142024-12-13T21:03:57.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 98d8b737-15c3-4468-97f0-e07f16eabb80 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38152024-12-13T21:03:57.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1226 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6e7c53ba-4588-4569-b28d-5fa03435024f response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
38162024-12-13T21:03:57.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
38172024-12-13T21:03:57.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38182024-12-13T21:03:57.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
38192024-12-13T21:03:57.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38202024-12-13T21:03:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38212024-12-13T21:03:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38222024-12-13T21:03:57.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232024-12-13T21:03:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38242024-12-13T21:03:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38252024-12-13T21:03:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38262024-12-13T21:03:57.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272024-12-13T21:03:57.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38282024-12-13T21:03:57.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38292024-12-13T21:03:57.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
38302024-12-13T21:03:57.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38312024-12-13T21:03:57.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38322024-12-13T21:03:57.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
38332024-12-13T21:03:57.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.982728ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
38342024-12-13T21:03:57.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38352024-12-13T21:03:57.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38362024-12-13T21:03:57.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.423449ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38372024-12-13T21:03:58.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f434ebb0-c709-4030-9abb-9a739f477ec1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38382024-12-13T21:03:58.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f434ebb0-c709-4030-9abb-9a739f477ec1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38392024-12-13T21:03:58.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f434ebb0-c709-4030-9abb-9a739f477ec1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38402024-12-13T21:03:59.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa2d3fec-fb6c-4f76-afdf-7ec98b4753bb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38412024-12-13T21:03:59.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa2d3fec-fb6c-4f76-afdf-7ec98b4753bb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38422024-12-13T21:03:59.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa2d3fec-fb6c-4f76-afdf-7ec98b4753bb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38432024-12-13T21:04:00.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2b1debe8-72ef-4393-9011-756ea6a266ac roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38442024-12-13T21:04:00.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2b1debe8-72ef-4393-9011-756ea6a266ac resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38452024-12-13T21:04:00.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2b1debe8-72ef-4393-9011-756ea6a266ac response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38462024-12-13T21:04:01.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d8b9150-8bd8-4e0a-bcd4-73ecd9ea8322 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38472024-12-13T21:04:01.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d8b9150-8bd8-4e0a-bcd4-73ecd9ea8322 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38482024-12-13T21:04:01.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d8b9150-8bd8-4e0a-bcd4-73ecd9ea8322 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38492024-12-13T21:04:02.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e1aa231b-dc0b-4443-ba05-f656d68a9657 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38502024-12-13T21:04:02.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e1aa231b-dc0b-4443-ba05-f656d68a9657 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38512024-12-13T21:04:02.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e1aa231b-dc0b-4443-ba05-f656d68a9657 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38522024-12-13T21:04:02.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c17f32e4-c939-4b1e-8d5d-c4839da7e99c roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
38532024-12-13T21:04:02.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c17f32e4-c939-4b1e-8d5d-c4839da7e99c resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
38542024-12-13T21:04:02.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c17f32e4-c939-4b1e-8d5d-c4839da7e99c response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
38552024-12-13T21:04:02.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 6bcb59cc-4191-48fe-8c1a-9c06abe00b0f roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
38562024-12-13T21:04:02.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 6bcb59cc-4191-48fe-8c1a-9c06abe00b0f resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
38572024-12-13T21:04:02.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 6bcb59cc-4191-48fe-8c1a-9c06abe00b0f response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
38582024-12-13T21:04:03.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b273a34b-f1b6-45b6-8884-7dea9e01b2fc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38592024-12-13T21:04:03.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b273a34b-f1b6-45b6-8884-7dea9e01b2fc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38602024-12-13T21:04:03.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b273a34b-f1b6-45b6-8884-7dea9e01b2fc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38612024-12-13T21:04:04.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f04ed09f-2555-42e4-8e57-b62afe309908 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38622024-12-13T21:04:04.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f04ed09f-2555-42e4-8e57-b62afe309908 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38632024-12-13T21:04:04.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f04ed09f-2555-42e4-8e57-b62afe309908 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38642024-12-13T21:04:05.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e83d6a5e-85c8-4b65-b66e-4328600f4766 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38652024-12-13T21:04:05.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e83d6a5e-85c8-4b65-b66e-4328600f4766 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38662024-12-13T21:04:05.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e83d6a5e-85c8-4b65-b66e-4328600f4766 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38672024-12-13T21:04:06.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c3979ec-54a7-490d-919f-d0648c503011 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38682024-12-13T21:04:06.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c3979ec-54a7-490d-919f-d0648c503011 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38692024-12-13T21:04:06.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c3979ec-54a7-490d-919f-d0648c503011 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38702024-12-13T21:04:07.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f3158fe-8f4d-4735-8d7c-b1fee238bd0f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38712024-12-13T21:04:07.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f3158fe-8f4d-4735-8d7c-b1fee238bd0f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38722024-12-13T21:04:07.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f3158fe-8f4d-4735-8d7c-b1fee238bd0f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
38732024-12-13T21:04:07.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1465 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6b402b8e-145b-434a-8594-32de50b97ed4 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
38742024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
38752024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38762024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
38772024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
38782024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38792024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38802024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
38812024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
38822024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
38832024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38842024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38852024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
38862024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38872024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
38882024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38892024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38902024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
38912024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
38922024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38932024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38942024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
38952024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38962024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
38972024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38982024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
38992024-12-13T21:04:07.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39002024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39012024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
39022024-12-13T21:04:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39032024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
39042024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39052024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
39062024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39072024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
39082024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39092024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39102024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39122024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39132024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39142024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39152024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39162024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39172024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39182024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39192024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39202024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39212024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39222024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39232024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39242024-12-13T21:04:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39252024-12-13T21:04:07.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262024-12-13T21:04:07.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.10739ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39272024-12-13T21:04:07.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39282024-12-13T21:04:07.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-12-13T21:04:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39302024-12-13T21:04:07.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39312024-12-13T21:04:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39322024-12-13T21:04:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39332024-12-13T21:04:07.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39342024-12-13T21:04:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39352024-12-13T21:04:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39362024-12-13T21:04:07.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39372024-12-13T21:04:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39382024-12-13T21:04:07.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1289, tv_nsec: 246150962 } })
39392024-12-13T21:04:07.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39402024-12-13T21:04:07.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.309532ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
39412024-12-13T21:04:07.734ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1289, tv_nsec: 247559488 } })
39422024-12-13T21:04:07.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39432024-12-13T21:04:07.735ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39442024-12-13T21:04:07.735ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39452024-12-13T21:04:07.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39462024-12-13T21:04:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39472024-12-13T21:04:07.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39482024-12-13T21:04:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39492024-12-13T21:04:07.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39502024-12-13T21:04:07.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39512024-12-13T21:04:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39522024-12-13T21:04:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39532024-12-13T21:04:07.738ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1289, tv_nsec: 251207593 } })
39542024-12-13T21:04:07.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39552024-12-13T21:04:07.738ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
39562024-12-13T21:04:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39572024-12-13T21:04:07.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39582024-12-13T21:04:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39592024-12-13T21:04:07.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.33568ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39602024-12-13T21:04:07.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39612024-12-13T21:04:07.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39622024-12-13T21:04:07.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39632024-12-13T21:04:07.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39642024-12-13T21:04:07.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39652024-12-13T21:04:07.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39662024-12-13T21:04:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39672024-12-13T21:04:07.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39682024-12-13T21:04:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39692024-12-13T21:04:07.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.981388ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
39702024-12-13T21:04:07.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39712024-12-13T21:04:07.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39722024-12-13T21:04:07.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39732024-12-13T21:04:07.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39742024-12-13T21:04:07.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.194906ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39752024-12-13T21:04:07.774ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39762024-12-13T21:04:07.774ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39772024-12-13T21:04:07.774ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39782024-12-13T21:04:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39792024-12-13T21:04:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39802024-12-13T21:04:07.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39812024-12-13T21:04:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39822024-12-13T21:04:07.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39832024-12-13T21:04:07.776ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39842024-12-13T21:04:07.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39852024-12-13T21:04:07.777ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39862024-12-13T21:04:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39872024-12-13T21:04:07.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39882024-12-13T21:04:07.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39892024-12-13T21:04:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39902024-12-13T21:04:07.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912024-12-13T21:04:07.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
39922024-12-13T21:04:07.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39932024-12-13T21:04:07.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39942024-12-13T21:04:07.789ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39952024-12-13T21:04:07.789ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39962024-12-13T21:04:07.789ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51e9e888-116e-4209-91c9-cf3dff40ad96", "content-length": "26", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
39972024-12-13T21:04:07.789ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39982024-12-13T21:04:07.791ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39992024-12-13T21:04:07.795ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
40002024-12-13T21:04:07.795ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40012024-12-13T21:04:07.795ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abf53214-5986-40eb-a191-49f2d1ded43e", "content-length": "26", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
40022024-12-13T21:04:07.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40032024-12-13T21:04:07.797ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
40042024-12-13T21:04:07.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40052024-12-13T21:04:07.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40062024-12-13T21:04:07.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40072024-12-13T21:04:07.801ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40082024-12-13T21:04:07.801ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40092024-12-13T21:04:07.801ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
40102024-12-13T21:04:07.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.184782ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
40112024-12-13T21:04:07.802ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f053f7fe-7226-4c67-aa8c-25440bf6fc7a", "content-length": "26", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
40122024-12-13T21:04:07.802ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40132024-12-13T21:04:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40142024-12-13T21:04:07.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40152024-12-13T21:04:07.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.369353ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40162024-12-13T21:04:07.809ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40172024-12-13T21:04:07.809ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40182024-12-13T21:04:07.809ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.624955ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40192024-12-13T21:04:07.814ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40202024-12-13T21:04:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40212024-12-13T21:04:07.817ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40222024-12-13T21:04:07.817ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.276273ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40232024-12-13T21:04:07.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242024-12-13T21:04:07.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40252024-12-13T21:04:07.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40262024-12-13T21:04:07.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
40272024-12-13T21:04:07.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40282024-12-13T21:04:07.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40292024-12-13T21:04:07.841ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.038235ms iteration = 14 status = 0
40302024-12-13T21:04:07.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.780013ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40312024-12-13T21:04:07.855ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.382382ms iteration = 17 status = {"physical_disks_added":0}
40322024-12-13T21:04:07.893ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40332024-12-13T21:04:07.893ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c608479-d0cc-42c1-b70a-25f3a5b6ac3f", "content-length": "1", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
40342024-12-13T21:04:07.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40352024-12-13T21:04:07.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40362024-12-13T21:04:07.896ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 172.070044ms iteration = 14 status = null
40372024-12-13T21:04:07.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40382024-12-13T21:04:07.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40392024-12-13T21:04:07.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402024-12-13T21:04:07.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40412024-12-13T21:04:07.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40422024-12-13T21:04:07.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40432024-12-13T21:04:07.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442024-12-13T21:04:07.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40452024-12-13T21:04:07.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40462024-12-13T21:04:07.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40472024-12-13T21:04:07.983ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.32184ms iteration = 14 status = {}
40482024-12-13T21:04:08.007ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40492024-12-13T21:04:08.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40502024-12-13T21:04:08.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c054a46b-2747-4fcd-acd7-3450a0583377", "content-length": "372", "date": "Fri, 13 Dec 2024 21:04:08 GMT"} })
40512024-12-13T21:04:08.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40522024-12-13T21:04:08.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40532024-12-13T21:04:08.023ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40542024-12-13T21:04:08.024ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f2bc4cd-0110-4cee-961d-aa1069138b2f", "content-length": "691", "date": "Fri, 13 Dec 2024 21:04:08 GMT"} })
40552024-12-13T21:04:08.024ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40562024-12-13T21:04:08.024ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40572024-12-13T21:04:08.024ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40582024-12-13T21:04:08.026ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 301.730487ms iteration = 14 status = {}
40592024-12-13T21:04:08.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40602024-12-13T21:04:08.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40612024-12-13T21:04:08.044ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
40622024-12-13T21:04:08.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40632024-12-13T21:04:08.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40642024-12-13T21:04:08.047ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40652024-12-13T21:04:08.047ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40662024-12-13T21:04:08.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ae129779-8a31-45be-a709-c0427e717049", "date": "Fri, 13 Dec 2024 21:04:08 GMT"} })
40672024-12-13T21:04:08.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40682024-12-13T21:04:08.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40692024-12-13T21:04:08.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40702024-12-13T21:04:08.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40712024-12-13T21:04:08.053ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40722024-12-13T21:04:08.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "065f1cc9-bf38-417b-95f0-69f74d10a976", "content-length": "134", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
40732024-12-13T21:04:08.053ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40742024-12-13T21:04:08.053ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
40752024-12-13T21:04:08.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40762024-12-13T21:04:08.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40772024-12-13T21:04:08.053ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40782024-12-13T21:04:08.053ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40792024-12-13T21:04:08.053ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40802024-12-13T21:04:08.053ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40812024-12-13T21:04:08.054ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40822024-12-13T21:04:08.054ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40832024-12-13T21:04:08.054ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40842024-12-13T21:04:08.054ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40852024-12-13T21:04:08.054ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
40862024-12-13T21:04:08.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40872024-12-13T21:04:08.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40882024-12-13T21:04:08.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40892024-12-13T21:04:08.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "193f7719-9efa-48cb-97cc-56c308a5c0aa", "content-length": "2", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
40902024-12-13T21:04:08.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40912024-12-13T21:04:08.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a48599-62f0-49d2-9c30-c47def642e9a", "content-length": "52", "date": "Fri, 13 Dec 2024 21:04:07 GMT"} })
40922024-12-13T21:04:08.056ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
40932024-12-13T21:04:08.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40942024-12-13T21:04:08.057ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40952024-12-13T21:04:08.057ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40962024-12-13T21:04:08.147ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff0848f4-5320-4446-a32e-2bafa44123b0", "date": "Fri, 13 Dec 2024 21:04:08 GMT"} })
40972024-12-13T21:04:08.147ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
40982024-12-13T21:04:08.147ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40992024-12-13T21:04:08.148ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f52b11ea-06ab-44b6-b33d-9e23ea8ad725", "date": "Fri, 13 Dec 2024 21:04:08 GMT"} })
41002024-12-13T21:04:08.149ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 424.694306ms iteration = 15 status = {}
41012024-12-13T21:04:08.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "80e85312-0330-487e-990b-7e90339e3d45", "content-length": "682", "date": "Fri, 13 Dec 2024 21:04:08 GMT"} })
41022024-12-13T21:04:08.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41032024-12-13T21:04:08.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41042024-12-13T21:04:08.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41052024-12-13T21:04:08.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41062024-12-13T21:04:08.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41072024-12-13T21:04:08.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41082024-12-13T21:04:08.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41092024-12-13T21:04:08.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41102024-12-13T21:04:08.167ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 442.937159ms iteration = 14 status = {}
41112024-12-13T21:04:08.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 186c3fc3-f949-47b1-98ae-3383f6b70eb8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41122024-12-13T21:04:08.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 186c3fc3-f949-47b1-98ae-3383f6b70eb8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41132024-12-13T21:04:08.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 186c3fc3-f949-47b1-98ae-3383f6b70eb8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41142024-12-13T21:04:09.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 5745b3d8-9e37-4671-a87e-3edd34df9f5a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41152024-12-13T21:04:09.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 5745b3d8-9e37-4671-a87e-3edd34df9f5a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41162024-12-13T21:04:09.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 5745b3d8-9e37-4671-a87e-3edd34df9f5a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41172024-12-13T21:04:09.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 742b549f-987c-4c2d-8200-d91b58973f86 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41182024-12-13T21:04:09.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 742b549f-987c-4c2d-8200-d91b58973f86 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41192024-12-13T21:04:09.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 742b549f-987c-4c2d-8200-d91b58973f86 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41202024-12-13T21:04:10.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f860547-4212-4b7d-88d7-b85a4ae0de12 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41212024-12-13T21:04:10.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f860547-4212-4b7d-88d7-b85a4ae0de12 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41222024-12-13T21:04:10.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f860547-4212-4b7d-88d7-b85a4ae0de12 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41232024-12-13T21:04:11.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 737755b1-ba34-48b7-821a-b190bf1499d2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41242024-12-13T21:04:11.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 737755b1-ba34-48b7-821a-b190bf1499d2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41252024-12-13T21:04:11.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 737755b1-ba34-48b7-821a-b190bf1499d2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41262024-12-13T21:04:12.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5058ec74-1672-4034-9ad3-7e59193d95d8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41272024-12-13T21:04:12.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5058ec74-1672-4034-9ad3-7e59193d95d8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41282024-12-13T21:04:12.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5058ec74-1672-4034-9ad3-7e59193d95d8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41292024-12-13T21:04:13.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 94ea13c3-19ed-42b0-9981-69b2f3ac976e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41302024-12-13T21:04:13.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 94ea13c3-19ed-42b0-9981-69b2f3ac976e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41312024-12-13T21:04:13.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 94ea13c3-19ed-42b0-9981-69b2f3ac976e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41322024-12-13T21:04:14.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6ac2c292-8b1d-40b6-9266-c68d20b826a9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41332024-12-13T21:04:14.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6ac2c292-8b1d-40b6-9266-c68d20b826a9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41342024-12-13T21:04:14.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6ac2c292-8b1d-40b6-9266-c68d20b826a9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41352024-12-13T21:04:15.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4677fed0-86e4-4b4c-be27-f57b02bb01bc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41362024-12-13T21:04:15.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4677fed0-86e4-4b4c-be27-f57b02bb01bc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41372024-12-13T21:04:15.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4677fed0-86e4-4b4c-be27-f57b02bb01bc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41382024-12-13T21:04:16.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb5e2741-2549-4178-8947-aa9677151638 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41392024-12-13T21:04:16.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb5e2741-2549-4178-8947-aa9677151638 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41402024-12-13T21:04:16.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb5e2741-2549-4178-8947-aa9677151638 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41412024-12-13T21:04:17.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1387 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 17d3c20b-6280-4cb0-a17e-35907799caa2 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
41422024-12-13T21:04:17.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
41432024-12-13T21:04:17.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41442024-12-13T21:04:17.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
41452024-12-13T21:04:17.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41462024-12-13T21:04:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41472024-12-13T21:04:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41482024-12-13T21:04:17.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41492024-12-13T21:04:17.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41502024-12-13T21:04:17.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512024-12-13T21:04:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41522024-12-13T21:04:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41532024-12-13T21:04:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41542024-12-13T21:04:17.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41552024-12-13T21:04:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41562024-12-13T21:04:17.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41572024-12-13T21:04:17.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
41582024-12-13T21:04:17.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41592024-12-13T21:04:17.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41602024-12-13T21:04:17.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
41612024-12-13T21:04:17.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.959733ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
41622024-12-13T21:04:17.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.068846ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41632024-12-13T21:04:17.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e2f0331-d60f-40e3-999f-5e085e4806c5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41642024-12-13T21:04:17.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e2f0331-d60f-40e3-999f-5e085e4806c5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41652024-12-13T21:04:17.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e2f0331-d60f-40e3-999f-5e085e4806c5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41662024-12-13T21:04:18.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a84a6b1f-64c9-482d-abeb-aafc6f45e862 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41672024-12-13T21:04:18.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a84a6b1f-64c9-482d-abeb-aafc6f45e862 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41682024-12-13T21:04:18.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a84a6b1f-64c9-482d-abeb-aafc6f45e862 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41692024-12-13T21:04:19.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a2e5ce3-13b3-4a04-bce7-5ce69e5d4679 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41702024-12-13T21:04:19.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a2e5ce3-13b3-4a04-bce7-5ce69e5d4679 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41712024-12-13T21:04:19.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a2e5ce3-13b3-4a04-bce7-5ce69e5d4679 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41722024-12-13T21:04:20.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eca09130-1fe2-4155-b5ac-b8de4a464222 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41732024-12-13T21:04:20.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eca09130-1fe2-4155-b5ac-b8de4a464222 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41742024-12-13T21:04:20.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eca09130-1fe2-4155-b5ac-b8de4a464222 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41752024-12-13T21:04:21.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7172c710-61d6-4d53-9725-b6b18c66173c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41762024-12-13T21:04:21.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7172c710-61d6-4d53-9725-b6b18c66173c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41772024-12-13T21:04:21.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7172c710-61d6-4d53-9725-b6b18c66173c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41782024-12-13T21:04:22.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cf880853-6b2a-40dd-b9c5-32a6dd2b93b9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41792024-12-13T21:04:22.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cf880853-6b2a-40dd-b9c5-32a6dd2b93b9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41802024-12-13T21:04:22.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cf880853-6b2a-40dd-b9c5-32a6dd2b93b9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41812024-12-13T21:04:23.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6ebb57bd-707b-4259-8bbb-1f370f6dc144 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41822024-12-13T21:04:23.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6ebb57bd-707b-4259-8bbb-1f370f6dc144 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41832024-12-13T21:04:23.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6ebb57bd-707b-4259-8bbb-1f370f6dc144 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41842024-12-13T21:04:24.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e1a19b1a-5980-4d08-992a-ed14fc2ebff2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41852024-12-13T21:04:24.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e1a19b1a-5980-4d08-992a-ed14fc2ebff2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41862024-12-13T21:04:24.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e1a19b1a-5980-4d08-992a-ed14fc2ebff2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41872024-12-13T21:04:26.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 50420875-f22c-485f-91cd-428427b534cb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41882024-12-13T21:04:26.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 50420875-f22c-485f-91cd-428427b534cb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41892024-12-13T21:04:26.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 50420875-f22c-485f-91cd-428427b534cb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41902024-12-13T21:04:27.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eb69cf7e-3ffc-4492-848b-033ebd3c382f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41912024-12-13T21:04:27.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eb69cf7e-3ffc-4492-848b-033ebd3c382f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41922024-12-13T21:04:27.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eb69cf7e-3ffc-4492-848b-033ebd3c382f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
41932024-12-13T21:04:27.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1198 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 049aa84d-caf2-4b30-b3ef-36432878a161 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
41942024-12-13T21:04:27.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
41952024-12-13T21:04:27.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41962024-12-13T21:04:27.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
41972024-12-13T21:04:27.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982024-12-13T21:04:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41992024-12-13T21:04:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42002024-12-13T21:04:27.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42012024-12-13T21:04:27.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42022024-12-13T21:04:27.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42032024-12-13T21:04:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42042024-12-13T21:04:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42052024-12-13T21:04:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42062024-12-13T21:04:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42072024-12-13T21:04:27.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42082024-12-13T21:04:27.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092024-12-13T21:04:27.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
42102024-12-13T21:04:27.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42112024-12-13T21:04:27.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42122024-12-13T21:04:27.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
42132024-12-13T21:04:27.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.316009ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
42142024-12-13T21:04:27.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.634155ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42152024-12-13T21:04:28.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a1808457-b458-4037-b08e-15f53ff8847c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42162024-12-13T21:04:28.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a1808457-b458-4037-b08e-15f53ff8847c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42172024-12-13T21:04:28.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a1808457-b458-4037-b08e-15f53ff8847c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42182024-12-13T21:04:29.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7a49c4a0-e820-4c2e-a1a0-240a8877f494 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42192024-12-13T21:04:29.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7a49c4a0-e820-4c2e-a1a0-240a8877f494 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42202024-12-13T21:04:29.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7a49c4a0-e820-4c2e-a1a0-240a8877f494 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42212024-12-13T21:04:30.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2047559e-4114-4053-8efd-edd996d8640b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42222024-12-13T21:04:30.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2047559e-4114-4053-8efd-edd996d8640b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42232024-12-13T21:04:30.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2047559e-4114-4053-8efd-edd996d8640b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42242024-12-13T21:04:31.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7745e8a-0d69-43f4-a351-68ef813bd3df roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42252024-12-13T21:04:31.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7745e8a-0d69-43f4-a351-68ef813bd3df resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42262024-12-13T21:04:31.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7745e8a-0d69-43f4-a351-68ef813bd3df response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42272024-12-13T21:04:32.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0d1c9d8c-6aeb-49f0-a5cf-fa46f3efda4a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42282024-12-13T21:04:32.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0d1c9d8c-6aeb-49f0-a5cf-fa46f3efda4a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42292024-12-13T21:04:32.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0d1c9d8c-6aeb-49f0-a5cf-fa46f3efda4a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42302024-12-13T21:04:33.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 15e3e28a-27f7-4ec8-87f9-61f10f8827e5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42312024-12-13T21:04:33.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 15e3e28a-27f7-4ec8-87f9-61f10f8827e5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42322024-12-13T21:04:33.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 15e3e28a-27f7-4ec8-87f9-61f10f8827e5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42332024-12-13T21:04:34.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7b51821-4956-4a07-b3ab-e0be766a5383 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42342024-12-13T21:04:34.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7b51821-4956-4a07-b3ab-e0be766a5383 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42352024-12-13T21:04:34.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7b51821-4956-4a07-b3ab-e0be766a5383 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42362024-12-13T21:04:35.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec69cf69-a900-4ea2-87c1-162eead33454 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42372024-12-13T21:04:35.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec69cf69-a900-4ea2-87c1-162eead33454 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42382024-12-13T21:04:35.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec69cf69-a900-4ea2-87c1-162eead33454 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42392024-12-13T21:04:36.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2e6f197f-fefd-4cad-9d3b-22b052b1a3ee roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42402024-12-13T21:04:36.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2e6f197f-fefd-4cad-9d3b-22b052b1a3ee resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42412024-12-13T21:04:36.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2e6f197f-fefd-4cad-9d3b-22b052b1a3ee response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42422024-12-13T21:04:37.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 787a48a5-b1aa-43ff-9950-ffdca494f480 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42432024-12-13T21:04:37.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 787a48a5-b1aa-43ff-9950-ffdca494f480 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42442024-12-13T21:04:37.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 787a48a5-b1aa-43ff-9950-ffdca494f480 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
42452024-12-13T21:04:37.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1231 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f8639f67-08bb-4648-a178-6e56e12d179d response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
42462024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
42472024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42482024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
42492024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
42502024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42512024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42522024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
42532024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42542024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
42552024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42562024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42572024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
42582024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
42592024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42602024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
42612024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42622024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42632024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
42642024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
42652024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42662024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
42672024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42682024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
42692024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
42702024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42712024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42722024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42732024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
42742024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42752024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
42762024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42772024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
42782024-12-13T21:04:37.724ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:54:37.724534569 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42792024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42802024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
42812024-12-13T21:04:37.724ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42822024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
42832024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42842024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
42852024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42862024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
42872024-12-13T21:04:37.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42882024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42892024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
42902024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
42912024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42922024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
42932024-12-13T21:04:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
42942024-12-13T21:04:37.724ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
42952024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.19\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
42962024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
42972024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
42982024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42992024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43002024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
43012024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43022024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
43032024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
43042024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43052024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43062024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43072024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
43082024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43092024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43102024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43112024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43122024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43132024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43142024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43152024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43162024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43172024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43182024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43192024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43202024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43212024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43222024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43232024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43242024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43252024-12-13T21:04:37.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 238422343 } })
43262024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43272024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43282024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43292024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43302024-12-13T21:04:37.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 238525046 } })
43312024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43322024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43332024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43342024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43352024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.309204ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43362024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43372024-12-13T21:04:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.300464ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43382024-12-13T21:04:37.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43392024-12-13T21:04:37.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402024-12-13T21:04:37.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 241421061 } })
43412024-12-13T21:04:37.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43422024-12-13T21:04:37.728ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.892721ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43432024-12-13T21:04:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43442024-12-13T21:04:37.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43452024-12-13T21:04:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43462024-12-13T21:04:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43472024-12-13T21:04:37.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43482024-12-13T21:04:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43492024-12-13T21:04:37.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-12-13T21:04:37.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43512024-12-13T21:04:37.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 246067401 } })
43522024-12-13T21:04:37.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43532024-12-13T21:04:37.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43542024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43552024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43562024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43572024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43582024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43592024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43602024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43612024-12-13T21:04:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43622024-12-13T21:04:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43632024-12-13T21:04:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43642024-12-13T21:04:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43652024-12-13T21:04:37.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43662024-12-13T21:04:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43672024-12-13T21:04:37.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43682024-12-13T21:04:37.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43692024-12-13T21:04:37.737ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:54:37.724534569 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43702024-12-13T21:04:37.737ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.708829ms iteration = 8 status = {"expiration":"2024-12-13T20:54:37.724534569Z","pruned":[]}
43712024-12-13T21:04:37.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43722024-12-13T21:04:37.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43732024-12-13T21:04:37.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43742024-12-13T21:04:37.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43752024-12-13T21:04:37.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43762024-12-13T21:04:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43772024-12-13T21:04:37.742ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.36046ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
43782024-12-13T21:04:37.742ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43792024-12-13T21:04:37.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43802024-12-13T21:04:37.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43812024-12-13T21:04:37.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43822024-12-13T21:04:37.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43832024-12-13T21:04:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43842024-12-13T21:04:37.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43852024-12-13T21:04:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43862024-12-13T21:04:37.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43872024-12-13T21:04:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43882024-12-13T21:04:37.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43892024-12-13T21:04:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43902024-12-13T21:04:37.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 263984236 } })
43912024-12-13T21:04:37.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
43922024-12-13T21:04:37.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43932024-12-13T21:04:37.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43942024-12-13T21:04:37.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-12-13T21:04:37.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
43962024-12-13T21:04:37.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43972024-12-13T21:04:37.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43982024-12-13T21:04:37.766ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992024-12-13T21:04:37.768ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44002024-12-13T21:04:37.768ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44012024-12-13T21:04:37.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44022024-12-13T21:04:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44032024-12-13T21:04:37.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44042024-12-13T21:04:37.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44052024-12-13T21:04:37.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44062024-12-13T21:04:37.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44072024-12-13T21:04:37.779ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-12-13T21:04:37.779ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44092024-12-13T21:04:37.779ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44102024-12-13T21:04:37.779ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44112024-12-13T21:04:37.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44122024-12-13T21:04:37.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.976582ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
44132024-12-13T21:04:37.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.649059ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
44142024-12-13T21:04:37.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44152024-12-13T21:04:37.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44162024-12-13T21:04:37.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44172024-12-13T21:04:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44182024-12-13T21:04:37.783ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44192024-12-13T21:04:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44202024-12-13T21:04:37.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.454988ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44212024-12-13T21:04:37.784ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44222024-12-13T21:04:37.784ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44232024-12-13T21:04:37.784ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.14722ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44242024-12-13T21:04:37.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44252024-12-13T21:04:37.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44262024-12-13T21:04:37.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44272024-12-13T21:04:37.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44282024-12-13T21:04:37.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44292024-12-13T21:04:37.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44302024-12-13T21:04:37.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312024-12-13T21:04:37.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44322024-12-13T21:04:37.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332024-12-13T21:04:37.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44342024-12-13T21:04:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44352024-12-13T21:04:37.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-12-13T21:04:37.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44372024-12-13T21:04:37.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44382024-12-13T21:04:37.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44392024-12-13T21:04:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
44402024-12-13T21:04:37.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44412024-12-13T21:04:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44422024-12-13T21:04:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44432024-12-13T21:04:37.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44442024-12-13T21:04:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44452024-12-13T21:04:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44462024-12-13T21:04:37.797ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
44472024-12-13T21:04:37.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.22944ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
44482024-12-13T21:04:37.797ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44492024-12-13T21:04:37.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.331342ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44502024-12-13T21:04:37.798ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.293167ms iteration = 15 status = 0
44512024-12-13T21:04:37.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.40579ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44522024-12-13T21:04:37.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44532024-12-13T21:04:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44542024-12-13T21:04:37.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.249555ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44552024-12-13T21:04:37.819ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44562024-12-13T21:04:37.819ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44572024-12-13T21:04:37.819ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.718767ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44582024-12-13T21:04:37.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592024-12-13T21:04:37.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44602024-12-13T21:04:37.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44612024-12-13T21:04:37.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44622024-12-13T21:04:37.824ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44632024-12-13T21:04:37.824ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44642024-12-13T21:04:37.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.629014ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44652024-12-13T21:04:37.825ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44662024-12-13T21:04:37.825ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44672024-12-13T21:04:37.825ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44682024-12-13T21:04:37.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44692024-12-13T21:04:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44702024-12-13T21:04:37.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44712024-12-13T21:04:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44722024-12-13T21:04:37.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44732024-12-13T21:04:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44742024-12-13T21:04:37.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.91644ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44752024-12-13T21:04:37.834ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44762024-12-13T21:04:37.834ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44772024-12-13T21:04:37.834ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44782024-12-13T21:04:37.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44792024-12-13T21:04:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44802024-12-13T21:04:37.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44812024-12-13T21:04:37.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44822024-12-13T21:04:37.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44832024-12-13T21:04:37.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44842024-12-13T21:04:37.855ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44852024-12-13T21:04:37.864ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44862024-12-13T21:04:37.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 140.271889ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44872024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44882024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
44892024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44902024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44912024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44922024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44932024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44942024-12-13T21:04:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44952024-12-13T21:04:37.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44962024-12-13T21:04:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44972024-12-13T21:04:37.878ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
44982024-12-13T21:04:37.878ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 154.663372ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44992024-12-13T21:04:37.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45002024-12-13T21:04:37.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45012024-12-13T21:04:37.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45022024-12-13T21:04:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45032024-12-13T21:04:37.885ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45042024-12-13T21:04:37.885ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45052024-12-13T21:04:37.885ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32535f16-198b-4ceb-8637-c54440d3fe1c", "content-length": "26", "date": "Fri, 13 Dec 2024 21:04:37 GMT"} })
45062024-12-13T21:04:37.885ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45072024-12-13T21:04:37.888ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45082024-12-13T21:04:37.901ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
45092024-12-13T21:04:37.901ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45102024-12-13T21:04:37.902ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.683839ms iteration = 18 status = {"physical_disks_added":0}
45112024-12-13T21:04:37.902ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3b9d1c5-d436-4373-a5e7-8c18a83133b8", "content-length": "26", "date": "Fri, 13 Dec 2024 21:04:37 GMT"} })
45122024-12-13T21:04:37.902ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45132024-12-13T21:04:37.904ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
45142024-12-13T21:04:37.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45152024-12-13T21:04:37.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45162024-12-13T21:04:37.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45172024-12-13T21:04:37.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45182024-12-13T21:04:37.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45192024-12-13T21:04:38.049ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45202024-12-13T21:04:38.049ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45212024-12-13T21:04:38.050ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22a1d967-4df2-46c5-8981-a9708155a14a", "content-length": "26", "date": "Fri, 13 Dec 2024 21:04:37 GMT"} })
45222024-12-13T21:04:38.050ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45232024-12-13T21:04:38.052ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45242024-12-13T21:04:38.072ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45252024-12-13T21:04:38.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45262024-12-13T21:04:38.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7aa42f4-5545-4551-aaf1-9ae979c5e97c", "content-length": "372", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
45272024-12-13T21:04:38.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45282024-12-13T21:04:38.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45292024-12-13T21:04:38.074ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.628819ms iteration = 15 status = {}
45302024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
45312024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45322024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
45332024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 350.888421ms iteration = 9 status = {"generation":2}
45342024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45352024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45362024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
45372024-12-13T21:04:38.075ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 351.187739ms iteration = 9 status = {"generation":1}
45382024-12-13T21:04:38.119ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45392024-12-13T21:04:38.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "08895b5c-1b6f-4ae0-a1ad-e07eab1af2b0", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45402024-12-13T21:04:38.120ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45412024-12-13T21:04:38.122ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "23b7d880-f0a8-43ba-ac4e-86f4d24e18d4", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45422024-12-13T21:04:38.122ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45432024-12-13T21:04:38.123ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45442024-12-13T21:04:38.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 399.182884ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45452024-12-13T21:04:38.126ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45462024-12-13T21:04:38.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45472024-12-13T21:04:38.127ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "94b30d70-438b-4166-b403-da3342f0deb7", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
45482024-12-13T21:04:38.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45492024-12-13T21:04:38.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45502024-12-13T21:04:38.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45512024-12-13T21:04:38.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45522024-12-13T21:04:38.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45532024-12-13T21:04:38.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45542024-12-13T21:04:38.140ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45552024-12-13T21:04:38.140ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45562024-12-13T21:04:38.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dd4a0bbf-6b70-4ffd-8455-d4f73eb24c6c", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
45572024-12-13T21:04:38.142ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 418.29214ms iteration = 16 status = {}
45582024-12-13T21:04:38.147ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45592024-12-13T21:04:38.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45602024-12-13T21:04:38.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45612024-12-13T21:04:38.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45622024-12-13T21:04:38.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45632024-12-13T21:04:38.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45642024-12-13T21:04:38.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45652024-12-13T21:04:38.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45662024-12-13T21:04:38.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45672024-12-13T21:04:38.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45682024-12-13T21:04:38.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45692024-12-13T21:04:38.164ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45702024-12-13T21:04:38.164ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0a37a14-bd83-4f36-be16-e2910a29aaaf", "content-length": "1", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
45712024-12-13T21:04:38.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45722024-12-13T21:04:38.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45732024-12-13T21:04:38.169ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 444.600652ms iteration = 15 status = null
45742024-12-13T21:04:38.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d5f3663-9c72-4073-b790-be8763bf138c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
45752024-12-13T21:04:38.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d5f3663-9c72-4073-b790-be8763bf138c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
45762024-12-13T21:04:38.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d5f3663-9c72-4073-b790-be8763bf138c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
45772024-12-13T21:04:38.314ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45782024-12-13T21:04:38.315ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2b82ebd-9850-4873-a763-3860df301eed", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45792024-12-13T21:04:38.315ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45802024-12-13T21:04:38.317ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e5e0f796-c0e4-4f8d-976c-96ed0e538752", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45812024-12-13T21:04:38.317ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45822024-12-13T21:04:38.318ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ff49a3cc-a371-49a5-a3f6-7fad0ba7e46a", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45832024-12-13T21:04:38.318ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45842024-12-13T21:04:38.320ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45852024-12-13T21:04:38.320ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 595.958698ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45862024-12-13T21:04:38.329ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45872024-12-13T21:04:38.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45882024-12-13T21:04:38.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45892024-12-13T21:04:38.334ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
45902024-12-13T21:04:38.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45912024-12-13T21:04:38.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45922024-12-13T21:04:38.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45932024-12-13T21:04:38.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd45617-f32b-4700-8994-d507c928fb9e", "content-length": "134", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
45942024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45952024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
45962024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45972024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45982024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45992024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46002024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46012024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46022024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46032024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46042024-12-13T21:04:38.345ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
46052024-12-13T21:04:38.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46062024-12-13T21:04:38.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46072024-12-13T21:04:38.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46082024-12-13T21:04:38.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8b4cfca-2613-4de8-8786-a74c5bed197d", "content-length": "2", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
46092024-12-13T21:04:38.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46102024-12-13T21:04:38.348ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f854e16-32dc-4bfa-a93a-025252c7e53b", "content-length": "52", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
46112024-12-13T21:04:38.348ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
46122024-12-13T21:04:38.348ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46132024-12-13T21:04:38.407ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3ba7ca0-8c91-4bac-bdcf-61d8808b69d8", "content-length": "691", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
46142024-12-13T21:04:38.407ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46152024-12-13T21:04:38.407ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46162024-12-13T21:04:38.407ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46172024-12-13T21:04:38.409ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 684.69643ms iteration = 15 status = {}
46182024-12-13T21:04:38.491ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ec2738e5-4533-4b11-a678-fc65e054d78f", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
46192024-12-13T21:04:38.491ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
46202024-12-13T21:04:38.491ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46212024-12-13T21:04:38.491ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "73bd5818-eeb2-487d-8ff2-12d4adb42c78", "content-length": "682", "date": "Fri, 13 Dec 2024 21:04:38 GMT"} })
46222024-12-13T21:04:38.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46232024-12-13T21:04:38.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46242024-12-13T21:04:38.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46252024-12-13T21:04:38.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46262024-12-13T21:04:38.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46272024-12-13T21:04:38.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46282024-12-13T21:04:38.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46292024-12-13T21:04:38.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46302024-12-13T21:04:38.508ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 783.922444ms iteration = 15 status = {}
46312024-12-13T21:04:39.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 10df7658-5cb8-4275-bc46-5daf7f33f0d2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46322024-12-13T21:04:39.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 10df7658-5cb8-4275-bc46-5daf7f33f0d2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46332024-12-13T21:04:39.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 10df7658-5cb8-4275-bc46-5daf7f33f0d2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46342024-12-13T21:04:39.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 04d73aaa-9bd1-4110-8a0c-b0c0914e6968 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46352024-12-13T21:04:39.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 04d73aaa-9bd1-4110-8a0c-b0c0914e6968 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46362024-12-13T21:04:39.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 04d73aaa-9bd1-4110-8a0c-b0c0914e6968 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46372024-12-13T21:04:40.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92cdb243-8273-41e3-b555-b9f96d5c3379 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46382024-12-13T21:04:40.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92cdb243-8273-41e3-b555-b9f96d5c3379 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46392024-12-13T21:04:40.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92cdb243-8273-41e3-b555-b9f96d5c3379 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46402024-12-13T21:04:41.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e946820c-b031-44be-aa5c-d170483f5f0c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46412024-12-13T21:04:41.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e946820c-b031-44be-aa5c-d170483f5f0c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46422024-12-13T21:04:41.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e946820c-b031-44be-aa5c-d170483f5f0c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46432024-12-13T21:04:42.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eca0c492-3e5d-46f6-8c45-10cc26f9662f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46442024-12-13T21:04:42.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eca0c492-3e5d-46f6-8c45-10cc26f9662f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46452024-12-13T21:04:42.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eca0c492-3e5d-46f6-8c45-10cc26f9662f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46462024-12-13T21:04:43.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 39d0fa49-81ad-45ea-9587-43c6fa2dd559 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46472024-12-13T21:04:43.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 39d0fa49-81ad-45ea-9587-43c6fa2dd559 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46482024-12-13T21:04:43.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 39d0fa49-81ad-45ea-9587-43c6fa2dd559 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46492024-12-13T21:04:44.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4fbcc3d-e581-4c01-9b5b-8668f086a5c9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46502024-12-13T21:04:44.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4fbcc3d-e581-4c01-9b5b-8668f086a5c9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46512024-12-13T21:04:44.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4fbcc3d-e581-4c01-9b5b-8668f086a5c9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46522024-12-13T21:04:45.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 467d3a95-7eb7-4189-9700-196280787539 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46532024-12-13T21:04:45.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 467d3a95-7eb7-4189-9700-196280787539 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46542024-12-13T21:04:45.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 467d3a95-7eb7-4189-9700-196280787539 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46552024-12-13T21:04:46.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b013d7a0-fc19-41da-b76e-c66e1c40f2ec roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46562024-12-13T21:04:46.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b013d7a0-fc19-41da-b76e-c66e1c40f2ec resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46572024-12-13T21:04:46.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b013d7a0-fc19-41da-b76e-c66e1c40f2ec response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46582024-12-13T21:04:47.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4dbf23a4-ea16-4783-b1c2-b8fb92336917 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46592024-12-13T21:04:47.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4dbf23a4-ea16-4783-b1c2-b8fb92336917 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46602024-12-13T21:04:47.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4dbf23a4-ea16-4783-b1c2-b8fb92336917 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46612024-12-13T21:04:47.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f6a466c9-9400-42ec-aaab-19c4a7f13b27 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
46622024-12-13T21:04:47.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
46632024-12-13T21:04:47.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
46642024-12-13T21:04:47.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46652024-12-13T21:04:47.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46662024-12-13T21:04:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46672024-12-13T21:04:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46682024-12-13T21:04:47.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46692024-12-13T21:04:47.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46702024-12-13T21:04:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46712024-12-13T21:04:47.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.706582ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46722024-12-13T21:04:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46732024-12-13T21:04:47.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46742024-12-13T21:04:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46752024-12-13T21:04:47.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46762024-12-13T21:04:47.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46772024-12-13T21:04:47.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46782024-12-13T21:04:47.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
46792024-12-13T21:04:47.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46802024-12-13T21:04:47.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46812024-12-13T21:04:47.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
46822024-12-13T21:04:47.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.401294ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
46832024-12-13T21:04:48.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 85c8bbcc-4ad4-414b-8d0f-ce583b8c1f0a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46842024-12-13T21:04:48.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 85c8bbcc-4ad4-414b-8d0f-ce583b8c1f0a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46852024-12-13T21:04:48.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 85c8bbcc-4ad4-414b-8d0f-ce583b8c1f0a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46862024-12-13T21:04:49.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ff5fc13-4c7c-42f8-a9db-482e9da4c24d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46872024-12-13T21:04:49.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ff5fc13-4c7c-42f8-a9db-482e9da4c24d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46882024-12-13T21:04:49.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ff5fc13-4c7c-42f8-a9db-482e9da4c24d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46892024-12-13T21:04:50.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83e93ef7-67ce-4400-a3eb-40215738ee3f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46902024-12-13T21:04:50.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83e93ef7-67ce-4400-a3eb-40215738ee3f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46912024-12-13T21:04:50.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83e93ef7-67ce-4400-a3eb-40215738ee3f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46922024-12-13T21:04:51.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82d2fc7c-4f4d-4e14-b303-86af04bfe7de roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46932024-12-13T21:04:51.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82d2fc7c-4f4d-4e14-b303-86af04bfe7de resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46942024-12-13T21:04:51.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82d2fc7c-4f4d-4e14-b303-86af04bfe7de response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46952024-12-13T21:04:52.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d7533e7e-4d95-42cc-8f13-a84788b25024 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46962024-12-13T21:04:52.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d7533e7e-4d95-42cc-8f13-a84788b25024 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46972024-12-13T21:04:52.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d7533e7e-4d95-42cc-8f13-a84788b25024 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46982024-12-13T21:04:53.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1f2d0107-2040-4dfd-b319-54cc34eb6b12 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
46992024-12-13T21:04:53.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1f2d0107-2040-4dfd-b319-54cc34eb6b12 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47002024-12-13T21:04:53.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1f2d0107-2040-4dfd-b319-54cc34eb6b12 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47012024-12-13T21:04:54.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 95905fff-d1f4-48f4-871a-4ca4969b3365 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47022024-12-13T21:04:54.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 95905fff-d1f4-48f4-871a-4ca4969b3365 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47032024-12-13T21:04:54.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 95905fff-d1f4-48f4-871a-4ca4969b3365 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47042024-12-13T21:04:55.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ffec096d-6baf-4338-a2da-0a666b3cb0f6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47052024-12-13T21:04:55.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ffec096d-6baf-4338-a2da-0a666b3cb0f6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47062024-12-13T21:04:55.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ffec096d-6baf-4338-a2da-0a666b3cb0f6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47072024-12-13T21:04:56.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78c48f28-8a5b-4055-adfa-bb07a07cd398 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47082024-12-13T21:04:56.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78c48f28-8a5b-4055-adfa-bb07a07cd398 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47092024-12-13T21:04:56.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78c48f28-8a5b-4055-adfa-bb07a07cd398 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47102024-12-13T21:04:57.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1579 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f8696af9-86f5-4753-a290-9ecc53a2f6c0 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
47112024-12-13T21:04:57.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad24af96-beeb-49a4-95eb-ac923da1ee02 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47122024-12-13T21:04:57.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad24af96-beeb-49a4-95eb-ac923da1ee02 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47132024-12-13T21:04:57.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad24af96-beeb-49a4-95eb-ac923da1ee02 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47142024-12-13T21:04:57.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
47152024-12-13T21:04:57.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
47162024-12-13T21:04:57.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47172024-12-13T21:04:57.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47182024-12-13T21:04:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47192024-12-13T21:04:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47202024-12-13T21:04:57.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47212024-12-13T21:04:57.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47222024-12-13T21:04:57.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47232024-12-13T21:04:57.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.047735ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47242024-12-13T21:04:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47252024-12-13T21:04:57.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47262024-12-13T21:04:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47272024-12-13T21:04:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47282024-12-13T21:04:57.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47292024-12-13T21:04:57.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47302024-12-13T21:04:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
47312024-12-13T21:04:57.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47322024-12-13T21:04:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47332024-12-13T21:04:57.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
47342024-12-13T21:04:57.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.121732ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
47352024-12-13T21:04:58.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b81086fa-62bd-467d-8b09-d540574a0b46 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47362024-12-13T21:04:58.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b81086fa-62bd-467d-8b09-d540574a0b46 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47372024-12-13T21:04:58.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b81086fa-62bd-467d-8b09-d540574a0b46 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47382024-12-13T21:04:59.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 21b3772d-3746-4a4a-ae11-1d2b58f79714 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47392024-12-13T21:04:59.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 21b3772d-3746-4a4a-ae11-1d2b58f79714 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47402024-12-13T21:04:59.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 21b3772d-3746-4a4a-ae11-1d2b58f79714 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47412024-12-13T21:05:00.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3a91d54d-d2ba-4388-92c1-363d4e5dc2e9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47422024-12-13T21:05:00.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3a91d54d-d2ba-4388-92c1-363d4e5dc2e9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47432024-12-13T21:05:00.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3a91d54d-d2ba-4388-92c1-363d4e5dc2e9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47442024-12-13T21:05:01.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 47dc9698-1876-43ba-961c-c70d2398d362 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47452024-12-13T21:05:01.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 47dc9698-1876-43ba-961c-c70d2398d362 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47462024-12-13T21:05:01.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 47dc9698-1876-43ba-961c-c70d2398d362 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47472024-12-13T21:05:02.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 61e2c552-04b5-4ca4-b9f3-a9b4363b8087 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47482024-12-13T21:05:02.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 61e2c552-04b5-4ca4-b9f3-a9b4363b8087 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47492024-12-13T21:05:02.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 61e2c552-04b5-4ca4-b9f3-a9b4363b8087 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47502024-12-13T21:05:03.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 59cd33fc-c82f-4fd3-bce6-88900a3bdad0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47512024-12-13T21:05:03.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 59cd33fc-c82f-4fd3-bce6-88900a3bdad0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47522024-12-13T21:05:03.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 59cd33fc-c82f-4fd3-bce6-88900a3bdad0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47532024-12-13T21:05:04.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f135aa98-5f48-4399-99da-38d977dd2e59 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47542024-12-13T21:05:04.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f135aa98-5f48-4399-99da-38d977dd2e59 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47552024-12-13T21:05:04.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f135aa98-5f48-4399-99da-38d977dd2e59 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47562024-12-13T21:05:05.581ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37679
47572024-12-13T21:05:05.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37679 req_id = 4a3e9e6f-b652-4ea9-a536-d0135b513b4f roles = RoleSet { roles: {} } uri = /metrics/producers
47582024-12-13T21:05:05.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37679 req_id = 4a3e9e6f-b652-4ea9-a536-d0135b513b4f resource = Database result = Ok(()) uri = /metrics/producers
47592024-12-13T21:05:05.616ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 9808715c-dad7-4981-b1eb-a6013e471643
47602024-12-13T21:05:05.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35076 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37679 req_id = 4a3e9e6f-b652-4ea9-a536-d0135b513b4f response_code = 201 uri = /metrics/producers
47612024-12-13T21:05:05.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd6dad85-3bb9-4327-8fa2-28fccfe2517a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47622024-12-13T21:05:05.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd6dad85-3bb9-4327-8fa2-28fccfe2517a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47632024-12-13T21:05:05.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd6dad85-3bb9-4327-8fa2-28fccfe2517a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47642024-12-13T21:05:06.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ca81b4e9-e885-4538-887c-bbcf609c2efe roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47652024-12-13T21:05:06.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ca81b4e9-e885-4538-887c-bbcf609c2efe resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47662024-12-13T21:05:06.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ca81b4e9-e885-4538-887c-bbcf609c2efe response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
47672024-12-13T21:05:07.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 72721f72-e782-4437-8be7-2af3109459c1 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
47682024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
47692024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47702024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
47712024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
47722024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47732024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47742024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47752024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
47762024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
47772024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
47782024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47792024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
47802024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47812024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47822024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
47832024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47842024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
47852024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47862024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
47872024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47882024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
47892024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47902024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
47912024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
47922024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47932024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47942024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
47952024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47962024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
47972024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47982024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
47992024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48002024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
48012024-12-13T21:05:07.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48022024-12-13T21:05:07.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48032024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48042024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48052024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48062024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48072024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48082024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48092024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48102024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48112024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48122024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48132024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48142024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48152024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48162024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48172024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48182024-12-13T21:05:07.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48192024-12-13T21:05:07.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48202024-12-13T21:05:07.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48212024-12-13T21:05:07.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.687342ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48222024-12-13T21:05:07.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1349, tv_nsec: 243064766 } })
48232024-12-13T21:05:07.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
48242024-12-13T21:05:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48252024-12-13T21:05:07.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48262024-12-13T21:05:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48272024-12-13T21:05:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48282024-12-13T21:05:07.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48292024-12-13T21:05:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48302024-12-13T21:05:07.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48312024-12-13T21:05:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48322024-12-13T21:05:07.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48332024-12-13T21:05:07.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48342024-12-13T21:05:07.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48352024-12-13T21:05:07.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48362024-12-13T21:05:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48372024-12-13T21:05:07.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48382024-12-13T21:05:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48392024-12-13T21:05:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48402024-12-13T21:05:07.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48412024-12-13T21:05:07.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422024-12-13T21:05:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48432024-12-13T21:05:07.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48442024-12-13T21:05:07.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.413872ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
48452024-12-13T21:05:07.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1349, tv_nsec: 251042383 } })
48462024-12-13T21:05:07.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
48472024-12-13T21:05:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48482024-12-13T21:05:07.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48492024-12-13T21:05:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48502024-12-13T21:05:07.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48512024-12-13T21:05:07.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48522024-12-13T21:05:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48532024-12-13T21:05:07.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48542024-12-13T21:05:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48552024-12-13T21:05:07.741ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1349, tv_nsec: 255044537 } })
48562024-12-13T21:05:07.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.301669ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48572024-12-13T21:05:07.741ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
48582024-12-13T21:05:07.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48592024-12-13T21:05:07.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48602024-12-13T21:05:07.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48612024-12-13T21:05:07.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48622024-12-13T21:05:07.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48632024-12-13T21:05:07.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48642024-12-13T21:05:07.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48652024-12-13T21:05:07.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48662024-12-13T21:05:07.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48672024-12-13T21:05:07.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
48682024-12-13T21:05:07.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48692024-12-13T21:05:07.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48702024-12-13T21:05:07.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48712024-12-13T21:05:07.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48722024-12-13T21:05:07.770ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48732024-12-13T21:05:07.770ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48742024-12-13T21:05:07.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48752024-12-13T21:05:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48762024-12-13T21:05:07.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.160094ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
48772024-12-13T21:05:07.773ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48782024-12-13T21:05:07.773ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48792024-12-13T21:05:07.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48802024-12-13T21:05:07.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48812024-12-13T21:05:07.775ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
48822024-12-13T21:05:07.775ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.857999ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
48832024-12-13T21:05:07.775ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48842024-12-13T21:05:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48852024-12-13T21:05:07.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.545649ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48862024-12-13T21:05:07.778ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48872024-12-13T21:05:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48882024-12-13T21:05:07.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48892024-12-13T21:05:07.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48902024-12-13T21:05:07.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48912024-12-13T21:05:07.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48922024-12-13T21:05:07.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48932024-12-13T21:05:07.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48942024-12-13T21:05:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48952024-12-13T21:05:07.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48962024-12-13T21:05:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48972024-12-13T21:05:07.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
48982024-12-13T21:05:07.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48992024-12-13T21:05:07.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49002024-12-13T21:05:07.789ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49012024-12-13T21:05:07.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.023357ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49022024-12-13T21:05:07.790ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.995441ms iteration = 16 status = 0
49032024-12-13T21:05:07.805ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49042024-12-13T21:05:07.805ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49052024-12-13T21:05:07.805ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.681793ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49062024-12-13T21:05:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49072024-12-13T21:05:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49082024-12-13T21:05:07.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.557581ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49092024-12-13T21:05:07.811ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49102024-12-13T21:05:07.811ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49112024-12-13T21:05:07.811ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25fbd1e2-e057-4370-98b1-8e861a9b1784", "content-length": "26", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49122024-12-13T21:05:07.811ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49132024-12-13T21:05:07.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49142024-12-13T21:05:07.823ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.549176ms iteration = 19 status = {"physical_disks_added":0}
49152024-12-13T21:05:07.832ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
49162024-12-13T21:05:07.832ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49172024-12-13T21:05:07.833ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb200530-8c51-4197-b1cd-6b5e0a2c40e0", "content-length": "26", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49182024-12-13T21:05:07.833ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49192024-12-13T21:05:07.835ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
49202024-12-13T21:05:07.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.276738ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49212024-12-13T21:05:07.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49222024-12-13T21:05:07.839ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49232024-12-13T21:05:07.839ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "915f52af-b2b1-4e25-9c5e-703c95891652", "content-length": "26", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49242024-12-13T21:05:07.839ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49252024-12-13T21:05:07.841ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49262024-12-13T21:05:07.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49272024-12-13T21:05:07.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49282024-12-13T21:05:07.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49292024-12-13T21:05:07.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49302024-12-13T21:05:07.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49312024-12-13T21:05:07.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49322024-12-13T21:05:07.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332024-12-13T21:05:07.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49342024-12-13T21:05:07.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49352024-12-13T21:05:07.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49362024-12-13T21:05:07.906ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.491777ms iteration = 16 status = {}
49372024-12-13T21:05:07.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86d81849-3162-467f-b506-57226a023ec2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
49382024-12-13T21:05:07.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86d81849-3162-467f-b506-57226a023ec2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
49392024-12-13T21:05:07.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86d81849-3162-467f-b506-57226a023ec2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
49402024-12-13T21:05:07.922ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49412024-12-13T21:05:07.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49422024-12-13T21:05:07.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "446b1685-c071-49c9-ab9e-d51605cab582", "content-length": "372", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49432024-12-13T21:05:07.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49442024-12-13T21:05:07.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49452024-12-13T21:05:07.931ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49462024-12-13T21:05:07.931ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "71c7a787-25b0-411d-ba11-951af78d53e3", "content-length": "1", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49472024-12-13T21:05:07.933ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49482024-12-13T21:05:07.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49492024-12-13T21:05:07.936ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.384043ms iteration = 16 status = null
49502024-12-13T21:05:07.966ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49512024-12-13T21:05:07.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e34702f-b3d4-42b7-958d-eacab62f4e0a", "content-length": "691", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49522024-12-13T21:05:07.967ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49532024-12-13T21:05:07.967ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49542024-12-13T21:05:07.967ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49552024-12-13T21:05:07.968ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 244.086511ms iteration = 16 status = {}
49562024-12-13T21:05:07.979ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49572024-12-13T21:05:07.979ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49582024-12-13T21:05:07.979ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1b9039ca-3d64-4fe2-b14c-b4435089e8a4", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49592024-12-13T21:05:07.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49602024-12-13T21:05:07.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49612024-12-13T21:05:07.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49622024-12-13T21:05:07.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49632024-12-13T21:05:07.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49642024-12-13T21:05:07.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49652024-12-13T21:05:07.989ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49662024-12-13T21:05:07.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49672024-12-13T21:05:07.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "29d8c8ee-8089-4efc-8a39-17e26fb0125c", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49682024-12-13T21:05:07.991ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.067957ms iteration = 17 status = {}
49692024-12-13T21:05:08.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49702024-12-13T21:05:08.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49712024-12-13T21:05:08.003ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
49722024-12-13T21:05:08.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49732024-12-13T21:05:08.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49742024-12-13T21:05:08.016ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49752024-12-13T21:05:08.017ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6862d67-fd97-4e5a-b051-0b41cbf1d881", "content-length": "134", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49762024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49772024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
49782024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49792024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49802024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49812024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49822024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49832024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49842024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49852024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49862024-12-13T21:05:08.017ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
49872024-12-13T21:05:08.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49882024-12-13T21:05:08.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49892024-12-13T21:05:08.020ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49902024-12-13T21:05:08.020ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9adf384a-7540-4793-b84f-78df5a5c9164", "content-length": "2", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49912024-12-13T21:05:08.020ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49922024-12-13T21:05:08.020ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "feb7e763-10b6-4f6f-8926-41cddb920c3c", "content-length": "52", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49932024-12-13T21:05:08.020ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
49942024-12-13T21:05:08.020ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49952024-12-13T21:05:08.108ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bce1a73b-7440-4b2c-9798-7fc7001233c1", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49962024-12-13T21:05:08.108ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
49972024-12-13T21:05:08.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49982024-12-13T21:05:08.109ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd0f06eb-972c-4ec2-821e-04b6a69704a7", "content-length": "682", "date": "Fri, 13 Dec 2024 21:05:07 GMT"} })
49992024-12-13T21:05:08.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50002024-12-13T21:05:08.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50012024-12-13T21:05:08.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50022024-12-13T21:05:08.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50032024-12-13T21:05:08.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50042024-12-13T21:05:08.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50052024-12-13T21:05:08.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50062024-12-13T21:05:08.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50072024-12-13T21:05:08.125ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 400.648002ms iteration = 16 status = {}
50082024-12-13T21:05:08.347ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38018
50092024-12-13T21:05:08.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38018 req_id = 7ed8c725-f51f-4f8c-9100-0299e2e35dfa roles = RoleSet { roles: {} } uri = /metrics/producers
50102024-12-13T21:05:08.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38018 req_id = 7ed8c725-f51f-4f8c-9100-0299e2e35dfa resource = Database result = Ok(()) uri = /metrics/producers
50112024-12-13T21:05:08.383ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 05a53e54-a11d-4f9d-b47d-dabf8673427d
50122024-12-13T21:05:08.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35958 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38018 req_id = 7ed8c725-f51f-4f8c-9100-0299e2e35dfa response_code = 201 uri = /metrics/producers
50132024-12-13T21:05:08.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b6168fc-80c7-4d96-94a1-5c4e8f305c65 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50142024-12-13T21:05:08.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b6168fc-80c7-4d96-94a1-5c4e8f305c65 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50152024-12-13T21:05:08.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b6168fc-80c7-4d96-94a1-5c4e8f305c65 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50162024-12-13T21:05:09.196ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33382
50172024-12-13T21:05:09.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33382 req_id = 18547e48-7e2d-4f70-9b99-e1bbe7de7f7c roles = RoleSet { roles: {} } uri = /metrics/producers
50182024-12-13T21:05:09.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33382 req_id = 18547e48-7e2d-4f70-9b99-e1bbe7de7f7c resource = Database result = Ok(()) uri = /metrics/producers
50192024-12-13T21:05:09.204ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 82024834-9725-4304-9edd-af6b519041b3
50202024-12-13T21:05:09.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7852 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33382 req_id = 18547e48-7e2d-4f70-9b99-e1bbe7de7f7c response_code = 201 uri = /metrics/producers
50212024-12-13T21:05:09.404ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36362
50222024-12-13T21:05:09.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36362 req_id = 79e07c59-625b-4426-ad7f-888b19b868d3 roles = RoleSet { roles: {} } uri = /metrics/producers
50232024-12-13T21:05:09.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36362 req_id = 79e07c59-625b-4426-ad7f-888b19b868d3 resource = Database result = Ok(()) uri = /metrics/producers
50242024-12-13T21:05:09.439ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 24d23071-4a22-4662-832b-fb2493a9b66b
50252024-12-13T21:05:09.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34809 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36362 req_id = 79e07c59-625b-4426-ad7f-888b19b868d3 response_code = 201 uri = /metrics/producers
50262024-12-13T21:05:09.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = abc2a751-92c1-493e-a6d9-2ec843ed257f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
50272024-12-13T21:05:09.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = abc2a751-92c1-493e-a6d9-2ec843ed257f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
50282024-12-13T21:05:09.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = abc2a751-92c1-493e-a6d9-2ec843ed257f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
50292024-12-13T21:05:09.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ecfc196-e6ad-4c60-ba44-f429ca35fa80 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50302024-12-13T21:05:09.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ecfc196-e6ad-4c60-ba44-f429ca35fa80 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50312024-12-13T21:05:09.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ecfc196-e6ad-4c60-ba44-f429ca35fa80 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50322024-12-13T21:05:10.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0e104d0-d57e-4c1e-abe0-ba5dfee0ba9f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50332024-12-13T21:05:10.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0e104d0-d57e-4c1e-abe0-ba5dfee0ba9f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50342024-12-13T21:05:10.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0e104d0-d57e-4c1e-abe0-ba5dfee0ba9f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50352024-12-13T21:05:12.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec6a43e2-d48e-4222-8107-d4ad2ed4f2e4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50362024-12-13T21:05:12.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec6a43e2-d48e-4222-8107-d4ad2ed4f2e4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50372024-12-13T21:05:12.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec6a43e2-d48e-4222-8107-d4ad2ed4f2e4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50382024-12-13T21:05:13.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c8c9bbe0-0b44-40a6-8d52-b759017b05ea roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50392024-12-13T21:05:13.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c8c9bbe0-0b44-40a6-8d52-b759017b05ea resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50402024-12-13T21:05:13.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c8c9bbe0-0b44-40a6-8d52-b759017b05ea response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50412024-12-13T21:05:13.923ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53997
50422024-12-13T21:05:13.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53997 req_id = 25c6b6e4-75ff-47b7-bf14-00ad4b1e99b3 roles = RoleSet { roles: {} } uri = /metrics/producers
50432024-12-13T21:05:13.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53997 req_id = 25c6b6e4-75ff-47b7-bf14-00ad4b1e99b3 resource = Database result = Ok(()) uri = /metrics/producers
50442024-12-13T21:05:13.963ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 3f777322-11c9-4c30-9537-a1cc3a15fe00
50452024-12-13T21:05:13.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40272 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53997 req_id = 25c6b6e4-75ff-47b7-bf14-00ad4b1e99b3 response_code = 201 uri = /metrics/producers
50462024-12-13T21:05:14.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2ec160ba-078f-4224-8b0f-e718e5f6446e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50472024-12-13T21:05:14.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2ec160ba-078f-4224-8b0f-e718e5f6446e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50482024-12-13T21:05:14.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2ec160ba-078f-4224-8b0f-e718e5f6446e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50492024-12-13T21:05:15.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83dc5bb9-cf31-44a4-b1e4-75fbe680b1e8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50502024-12-13T21:05:15.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83dc5bb9-cf31-44a4-b1e4-75fbe680b1e8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50512024-12-13T21:05:15.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83dc5bb9-cf31-44a4-b1e4-75fbe680b1e8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50522024-12-13T21:05:16.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5b8a3163-e91a-48a9-996d-8f60cbec2516 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50532024-12-13T21:05:16.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5b8a3163-e91a-48a9-996d-8f60cbec2516 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50542024-12-13T21:05:16.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5b8a3163-e91a-48a9-996d-8f60cbec2516 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50552024-12-13T21:05:17.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 489a1e10-8640-477d-92c2-fb76cafc31c5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50562024-12-13T21:05:17.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 489a1e10-8640-477d-92c2-fb76cafc31c5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50572024-12-13T21:05:17.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 489a1e10-8640-477d-92c2-fb76cafc31c5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50582024-12-13T21:05:17.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1452 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d28b4621-04b0-43f7-a1b9-ca2a02801335 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
50592024-12-13T21:05:17.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
50602024-12-13T21:05:17.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
50612024-12-13T21:05:17.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50622024-12-13T21:05:17.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50632024-12-13T21:05:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50642024-12-13T21:05:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50652024-12-13T21:05:17.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50662024-12-13T21:05:17.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50672024-12-13T21:05:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50682024-12-13T21:05:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50692024-12-13T21:05:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50702024-12-13T21:05:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50712024-12-13T21:05:17.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50722024-12-13T21:05:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50732024-12-13T21:05:17.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50742024-12-13T21:05:17.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
50752024-12-13T21:05:17.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50762024-12-13T21:05:17.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50772024-12-13T21:05:17.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
50782024-12-13T21:05:17.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.168232ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
50792024-12-13T21:05:17.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.072626ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50802024-12-13T21:05:18.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9040e1ed-7d81-4e8a-9081-0fec1808df08 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50812024-12-13T21:05:18.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9040e1ed-7d81-4e8a-9081-0fec1808df08 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50822024-12-13T21:05:18.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9040e1ed-7d81-4e8a-9081-0fec1808df08 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50832024-12-13T21:05:19.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a9bbd14a-ef27-48a0-81ab-738e8bc2364c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50842024-12-13T21:05:19.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a9bbd14a-ef27-48a0-81ab-738e8bc2364c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50852024-12-13T21:05:19.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a9bbd14a-ef27-48a0-81ab-738e8bc2364c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50862024-12-13T21:05:20.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4ae57483-1f13-485f-a60e-dc62457e2626 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50872024-12-13T21:05:20.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4ae57483-1f13-485f-a60e-dc62457e2626 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50882024-12-13T21:05:20.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4ae57483-1f13-485f-a60e-dc62457e2626 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50892024-12-13T21:05:21.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c99767e-6d9f-430b-b3bf-057742a6679f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50902024-12-13T21:05:21.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c99767e-6d9f-430b-b3bf-057742a6679f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50912024-12-13T21:05:21.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c99767e-6d9f-430b-b3bf-057742a6679f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50922024-12-13T21:05:22.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cf792a59-9f9a-4c2c-aa9b-b14de21fe173 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50932024-12-13T21:05:22.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cf792a59-9f9a-4c2c-aa9b-b14de21fe173 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50942024-12-13T21:05:22.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cf792a59-9f9a-4c2c-aa9b-b14de21fe173 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50952024-12-13T21:05:23.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8abcd619-c186-43f8-aa65-c045f9523e53 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50962024-12-13T21:05:23.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8abcd619-c186-43f8-aa65-c045f9523e53 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50972024-12-13T21:05:23.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8abcd619-c186-43f8-aa65-c045f9523e53 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50982024-12-13T21:05:24.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f6a76351-3b5b-4fcd-a29d-03d91d1bd54c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
50992024-12-13T21:05:24.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f6a76351-3b5b-4fcd-a29d-03d91d1bd54c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51002024-12-13T21:05:24.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f6a76351-3b5b-4fcd-a29d-03d91d1bd54c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51012024-12-13T21:05:25.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bd7147bf-c758-410b-a116-e2ab2cc0d9a4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51022024-12-13T21:05:25.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bd7147bf-c758-410b-a116-e2ab2cc0d9a4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51032024-12-13T21:05:25.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bd7147bf-c758-410b-a116-e2ab2cc0d9a4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51042024-12-13T21:05:26.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1bbaa3d1-22f6-4501-9323-28ce791d03aa roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51052024-12-13T21:05:26.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1bbaa3d1-22f6-4501-9323-28ce791d03aa resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51062024-12-13T21:05:26.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1bbaa3d1-22f6-4501-9323-28ce791d03aa response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51072024-12-13T21:05:26.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:41687
51082024-12-13T21:05:26.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41687 req_id = 9bf0c016-20a3-44ed-bdd7-43a954185f09 roles = RoleSet { roles: {} } uri = /metrics/producers
51092024-12-13T21:05:26.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41687 req_id = 9bf0c016-20a3-44ed-bdd7-43a954185f09 resource = Database result = Ok(()) uri = /metrics/producers
51102024-12-13T21:05:26.950ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 80dcafa7-ddfc-4f6b-a596-bd2a7d203daf
51112024-12-13T21:05:26.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8411 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41687 req_id = 9bf0c016-20a3-44ed-bdd7-43a954185f09 response_code = 201 uri = /metrics/producers
51122024-12-13T21:05:27.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec0f3aa8-04b3-4858-a13d-9626cefad2a3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51132024-12-13T21:05:27.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec0f3aa8-04b3-4858-a13d-9626cefad2a3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51142024-12-13T21:05:27.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ec0f3aa8-04b3-4858-a13d-9626cefad2a3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51152024-12-13T21:05:27.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1241 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6facea9b-39ec-4002-a329-a245d2479ba3 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
51162024-12-13T21:05:27.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
51172024-12-13T21:05:27.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51182024-12-13T21:05:27.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
51192024-12-13T21:05:27.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51202024-12-13T21:05:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51212024-12-13T21:05:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51222024-12-13T21:05:27.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51232024-12-13T21:05:27.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51242024-12-13T21:05:27.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-12-13T21:05:27.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.371938ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51262024-12-13T21:05:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51272024-12-13T21:05:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51282024-12-13T21:05:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51292024-12-13T21:05:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51302024-12-13T21:05:27.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51312024-12-13T21:05:27.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51322024-12-13T21:05:27.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
51332024-12-13T21:05:27.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51342024-12-13T21:05:27.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51352024-12-13T21:05:27.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
51362024-12-13T21:05:27.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.730034ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
51372024-12-13T21:05:28.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 686186e6-da2a-4017-b136-821296904b6a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51382024-12-13T21:05:28.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 686186e6-da2a-4017-b136-821296904b6a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51392024-12-13T21:05:28.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 686186e6-da2a-4017-b136-821296904b6a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51402024-12-13T21:05:29.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed1bcb37-d51b-4965-b2bd-45eb9c9b8b21 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51412024-12-13T21:05:29.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed1bcb37-d51b-4965-b2bd-45eb9c9b8b21 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51422024-12-13T21:05:29.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed1bcb37-d51b-4965-b2bd-45eb9c9b8b21 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51432024-12-13T21:05:30.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fef6029b-8e17-4396-ab97-484230f21cf3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51442024-12-13T21:05:30.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fef6029b-8e17-4396-ab97-484230f21cf3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51452024-12-13T21:05:30.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fef6029b-8e17-4396-ab97-484230f21cf3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51462024-12-13T21:05:31.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86dc09d3-8bd3-4c49-8211-d07180f114d6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51472024-12-13T21:05:31.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86dc09d3-8bd3-4c49-8211-d07180f114d6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51482024-12-13T21:05:31.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86dc09d3-8bd3-4c49-8211-d07180f114d6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51492024-12-13T21:05:32.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 645ab476-6cd8-4baf-9f52-f39f90dc79a9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51502024-12-13T21:05:32.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 645ab476-6cd8-4baf-9f52-f39f90dc79a9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51512024-12-13T21:05:32.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 645ab476-6cd8-4baf-9f52-f39f90dc79a9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51522024-12-13T21:05:32.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = e2fede31-9dbe-41bf-b0ed-ce27f735c1f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
51532024-12-13T21:05:32.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = e2fede31-9dbe-41bf-b0ed-ce27f735c1f2 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
51542024-12-13T21:05:32.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = e2fede31-9dbe-41bf-b0ed-ce27f735c1f2 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
51552024-12-13T21:05:32.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = e67911cf-95bb-4640-8a14-fc616325fc02 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
51562024-12-13T21:05:32.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = e67911cf-95bb-4640-8a14-fc616325fc02 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
51572024-12-13T21:05:32.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = e67911cf-95bb-4640-8a14-fc616325fc02 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
51582024-12-13T21:05:33.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22309cdb-c486-4559-b6d4-7c4bb6b4f240 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51592024-12-13T21:05:33.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22309cdb-c486-4559-b6d4-7c4bb6b4f240 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51602024-12-13T21:05:33.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22309cdb-c486-4559-b6d4-7c4bb6b4f240 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51612024-12-13T21:05:34.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 00826568-adc4-48db-9cbf-6dbef2c9c870 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51622024-12-13T21:05:34.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 00826568-adc4-48db-9cbf-6dbef2c9c870 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51632024-12-13T21:05:34.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 00826568-adc4-48db-9cbf-6dbef2c9c870 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51642024-12-13T21:05:35.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 502526d5-3f85-45f5-9bc4-72367ce4e8ab roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51652024-12-13T21:05:35.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 502526d5-3f85-45f5-9bc4-72367ce4e8ab resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51662024-12-13T21:05:35.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 502526d5-3f85-45f5-9bc4-72367ce4e8ab response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51672024-12-13T21:05:36.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 429d1f1a-7226-43f8-8df9-f427f39d794b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51682024-12-13T21:05:36.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 429d1f1a-7226-43f8-8df9-f427f39d794b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51692024-12-13T21:05:36.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 429d1f1a-7226-43f8-8df9-f427f39d794b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51702024-12-13T21:05:37.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71009b39-14ff-4a6e-b7dc-b0c5eaccd320 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51712024-12-13T21:05:37.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71009b39-14ff-4a6e-b7dc-b0c5eaccd320 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51722024-12-13T21:05:37.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71009b39-14ff-4a6e-b7dc-b0c5eaccd320 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
51732024-12-13T21:05:37.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1343 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ffedb4fa-71b6-4cb6-8932-843d73bdeb50 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
51742024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
51752024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
51762024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51772024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
51782024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51792024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51802024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
51812024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51822024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51832024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
51842024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
51852024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
51862024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51872024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51882024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51892024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
51902024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
51912024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51922024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
51932024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
51942024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51952024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
51962024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51972024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
51982024-12-13T21:05:37.724ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
51992024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.961\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
52002024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
52012024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
52022024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52032024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
52042024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52052024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
52062024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
52072024-12-13T21:05:37.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52082024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
52092024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52102024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52112024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
52122024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52132024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
52142024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52152024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
52162024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52172024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
52182024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
52192024-12-13T21:05:37.724ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:55:37.724387338 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52202024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52212024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
52222024-12-13T21:05:37.724ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52232024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52242024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
52252024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52262024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
52272024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52282024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
52292024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52302024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
52312024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
52322024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52332024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
52342024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52352024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52362024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52372024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52382024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52392024-12-13T21:05:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52402024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52412024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52422024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52432024-12-13T21:05:37.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 238443138 } })
52442024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52452024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52462024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52472024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52482024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52492024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52502024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52512024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52522024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52532024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52542024-12-13T21:05:37.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 238625142 } })
52552024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52562024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52572024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52582024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52592024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52602024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52612024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52622024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
52632024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.16984ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
52642024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
52652024-12-13T21:05:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.15426ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
52662024-12-13T21:05:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52672024-12-13T21:05:37.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52682024-12-13T21:05:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52692024-12-13T21:05:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52702024-12-13T21:05:37.727ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52712024-12-13T21:05:37.727ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52722024-12-13T21:05:37.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52732024-12-13T21:05:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52742024-12-13T21:05:37.728ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.927112ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52752024-12-13T21:05:37.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-12-13T21:05:37.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52772024-12-13T21:05:37.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782024-12-13T21:05:37.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52792024-12-13T21:05:37.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802024-12-13T21:05:37.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52812024-12-13T21:05:37.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52822024-12-13T21:05:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52832024-12-13T21:05:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52842024-12-13T21:05:37.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52852024-12-13T21:05:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52862024-12-13T21:05:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52872024-12-13T21:05:37.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52882024-12-13T21:05:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52892024-12-13T21:05:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52902024-12-13T21:05:37.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52912024-12-13T21:05:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52922024-12-13T21:05:37.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52932024-12-13T21:05:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52942024-12-13T21:05:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52952024-12-13T21:05:37.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52962024-12-13T21:05:37.735ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:55:37.724387338 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52972024-12-13T21:05:37.735ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.751469ms iteration = 9 status = {"expiration":"2024-12-13T20:55:37.724387338Z","pruned":[]}
52982024-12-13T21:05:37.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 248696073 } })
52992024-12-13T21:05:37.735ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53002024-12-13T21:05:37.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53012024-12-13T21:05:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53022024-12-13T21:05:37.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53032024-12-13T21:05:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53042024-12-13T21:05:37.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53052024-12-13T21:05:37.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53062024-12-13T21:05:37.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53072024-12-13T21:05:37.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 251349382 } })
53082024-12-13T21:05:37.738ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53092024-12-13T21:05:37.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53102024-12-13T21:05:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53112024-12-13T21:05:37.740ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.392206ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
53122024-12-13T21:05:37.740ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53132024-12-13T21:05:37.740ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53142024-12-13T21:05:37.740ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.518918ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53152024-12-13T21:05:37.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162024-12-13T21:05:37.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53172024-12-13T21:05:37.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53182024-12-13T21:05:37.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53192024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53202024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53212024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53222024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53232024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53242024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53252024-12-13T21:05:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53262024-12-13T21:05:37.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53272024-12-13T21:05:37.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53282024-12-13T21:05:37.748ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 262405419 } })
53292024-12-13T21:05:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53302024-12-13T21:05:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53312024-12-13T21:05:37.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
53322024-12-13T21:05:37.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53332024-12-13T21:05:37.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53342024-12-13T21:05:37.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53352024-12-13T21:05:37.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53362024-12-13T21:05:37.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53372024-12-13T21:05:37.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53382024-12-13T21:05:37.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53392024-12-13T21:05:37.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-12-13T21:05:37.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
53412024-12-13T21:05:37.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53422024-12-13T21:05:37.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53432024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53442024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53452024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53462024-12-13T21:05:37.756ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53472024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 31.712032ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53482024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53492024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53502024-12-13T21:05:37.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53512024-12-13T21:05:37.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
53522024-12-13T21:05:37.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53532024-12-13T21:05:37.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53542024-12-13T21:05:37.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.84353ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
53552024-12-13T21:05:37.780ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53562024-12-13T21:05:37.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53572024-12-13T21:05:37.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53582024-12-13T21:05:37.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53592024-12-13T21:05:37.783ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53602024-12-13T21:05:37.783ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53612024-12-13T21:05:37.783ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53622024-12-13T21:05:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53632024-12-13T21:05:37.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.817534ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
53642024-12-13T21:05:37.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53652024-12-13T21:05:37.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.397808ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53662024-12-13T21:05:37.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53672024-12-13T21:05:37.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53682024-12-13T21:05:37.786ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53692024-12-13T21:05:37.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53702024-12-13T21:05:37.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.62669ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53712024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
53722024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.150004ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
53732024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53742024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53752024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53762024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53772024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53782024-12-13T21:05:37.788ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
53792024-12-13T21:05:37.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53802024-12-13T21:05:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53812024-12-13T21:05:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53822024-12-13T21:05:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53832024-12-13T21:05:37.789ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53842024-12-13T21:05:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53852024-12-13T21:05:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
53862024-12-13T21:05:37.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53872024-12-13T21:05:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53882024-12-13T21:05:37.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 69.273146ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53892024-12-13T21:05:37.793ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53902024-12-13T21:05:37.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53912024-12-13T21:05:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53922024-12-13T21:05:37.794ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.58446ms iteration = 17 status = 0
53932024-12-13T21:05:37.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942024-12-13T21:05:37.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-12-13T21:05:37.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53962024-12-13T21:05:37.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53972024-12-13T21:05:37.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53982024-12-13T21:05:37.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53992024-12-13T21:05:37.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54002024-12-13T21:05:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54012024-12-13T21:05:37.799ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
54022024-12-13T21:05:37.799ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54032024-12-13T21:05:37.799ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
54042024-12-13T21:05:37.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 75.331484ms iteration = 10 status = {"generation":2}
54052024-12-13T21:05:37.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54062024-12-13T21:05:37.801ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54072024-12-13T21:05:37.801ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54082024-12-13T21:05:37.801ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54092024-12-13T21:05:37.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54102024-12-13T21:05:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54112024-12-13T21:05:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54122024-12-13T21:05:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54132024-12-13T21:05:37.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54142024-12-13T21:05:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54152024-12-13T21:05:37.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54162024-12-13T21:05:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54172024-12-13T21:05:37.807ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54182024-12-13T21:05:37.807ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54192024-12-13T21:05:37.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54202024-12-13T21:05:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54212024-12-13T21:05:37.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-12-13T21:05:37.810ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
54232024-12-13T21:05:37.810ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 85.852157ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54242024-12-13T21:05:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54252024-12-13T21:05:37.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54262024-12-13T21:05:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54272024-12-13T21:05:37.814ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54282024-12-13T21:05:37.814ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54292024-12-13T21:05:37.814ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
54302024-12-13T21:05:37.814ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 90.683252ms iteration = 10 status = {"generation":1}
54312024-12-13T21:05:37.817ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54322024-12-13T21:05:37.817ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54332024-12-13T21:05:37.817ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.049294ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54342024-12-13T21:05:37.824ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54352024-12-13T21:05:37.824ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54362024-12-13T21:05:37.824ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.432745ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54372024-12-13T21:05:37.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.929682ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54382024-12-13T21:05:37.840ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
54392024-12-13T21:05:37.840ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 116.899403ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54402024-12-13T21:05:37.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54412024-12-13T21:05:37.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54422024-12-13T21:05:37.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54432024-12-13T21:05:37.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54442024-12-13T21:05:37.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54452024-12-13T21:05:37.863ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.245982ms iteration = 20 status = {"physical_disks_added":0}
54462024-12-13T21:05:37.891ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54472024-12-13T21:05:37.891ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54482024-12-13T21:05:37.891ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "92c6e9fb-4c22-4a0e-b7d6-05a8f7ebeb8b", "content-length": "26", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
54492024-12-13T21:05:37.891ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54502024-12-13T21:05:37.893ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54512024-12-13T21:05:37.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
54522024-12-13T21:05:37.905ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54532024-12-13T21:05:37.905ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d9daa53-b634-4cc0-af75-671390415467", "content-length": "26", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
54542024-12-13T21:05:37.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54552024-12-13T21:05:37.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
54562024-12-13T21:05:37.967ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54572024-12-13T21:05:38.005ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54582024-12-13T21:05:38.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54592024-12-13T21:05:38.006ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2793d20d-90a4-4d1a-9e2e-1b474254dd1b", "content-length": "372", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} })
54602024-12-13T21:05:38.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54612024-12-13T21:05:38.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54622024-12-13T21:05:38.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-12-13T21:05:38.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54642024-12-13T21:05:38.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54652024-12-13T21:05:38.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54662024-12-13T21:05:38.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54672024-12-13T21:05:38.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54682024-12-13T21:05:38.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54692024-12-13T21:05:38.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54702024-12-13T21:05:38.045ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54712024-12-13T21:05:38.045ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54722024-12-13T21:05:38.045ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "25e50b46-857b-4b7d-b24d-96edb9b23c8d", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} })
54732024-12-13T21:05:38.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54742024-12-13T21:05:38.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54752024-12-13T21:05:38.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54762024-12-13T21:05:38.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54772024-12-13T21:05:38.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54782024-12-13T21:05:38.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54792024-12-13T21:05:38.053ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54802024-12-13T21:05:38.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54812024-12-13T21:05:38.053ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a52b3d3-bcc5-4b7d-aca9-025cdb57b5ac", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} })
54822024-12-13T21:05:38.055ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 331.147579ms iteration = 18 status = {}
54832024-12-13T21:05:38.061ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54842024-12-13T21:05:38.061ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54852024-12-13T21:05:38.061ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc6b0328-c64a-409f-948d-b3dfae007ded", "content-length": "26", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
54862024-12-13T21:05:38.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54872024-12-13T21:05:38.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54882024-12-13T21:05:38.063ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54892024-12-13T21:05:38.063ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ddbacba-7d77-4e8d-91c4-cb5e66f7cbff", "content-length": "1", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
54902024-12-13T21:05:38.065ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54912024-12-13T21:05:38.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54922024-12-13T21:05:38.067ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.464899ms iteration = 17 status = null
54932024-12-13T21:05:38.113ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54942024-12-13T21:05:38.162ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54952024-12-13T21:05:38.163ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85fee956-17c4-4e1e-896c-53c9a4af9c9e", "content-length": "691", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} })
54962024-12-13T21:05:38.163ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54972024-12-13T21:05:38.163ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54982024-12-13T21:05:38.163ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54992024-12-13T21:05:38.165ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 440.829264ms iteration = 17 status = {}
55002024-12-13T21:05:38.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55012024-12-13T21:05:38.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "706227da-3086-4ae7-91c9-9574efcab6eb", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55022024-12-13T21:05:38.174ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55032024-12-13T21:05:38.176ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "42209d28-a3ea-45ce-9c92-151f4e148991", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55042024-12-13T21:05:38.176ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55052024-12-13T21:05:38.179ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55062024-12-13T21:05:38.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 454.903879ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55072024-12-13T21:05:38.194ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 469.865937ms iteration = 17 status = {}
55082024-12-13T21:05:38.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55092024-12-13T21:05:38.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4ecf1444-c863-4746-abb2-6543e6ed0f1d", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55102024-12-13T21:05:38.277ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55112024-12-13T21:05:38.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ac5a5ef4-516e-45de-99f6-c51570db66b6", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55122024-12-13T21:05:38.279ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55132024-12-13T21:05:38.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bdef7971-40da-4adc-86e3-a17a677b4762", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55142024-12-13T21:05:38.281ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55152024-12-13T21:05:38.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
55162024-12-13T21:05:38.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 559.109923ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55172024-12-13T21:05:38.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55182024-12-13T21:05:38.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55192024-12-13T21:05:38.331ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
55202024-12-13T21:05:38.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55212024-12-13T21:05:38.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55222024-12-13T21:05:38.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55232024-12-13T21:05:38.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f33193-aa75-48ca-b6a2-0b70110cb09b", "content-length": "134", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
55242024-12-13T21:05:38.341ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55252024-12-13T21:05:38.341ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
55262024-12-13T21:05:38.341ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55272024-12-13T21:05:38.341ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55282024-12-13T21:05:38.341ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55292024-12-13T21:05:38.341ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55302024-12-13T21:05:38.342ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55312024-12-13T21:05:38.342ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55322024-12-13T21:05:38.342ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55332024-12-13T21:05:38.342ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55342024-12-13T21:05:38.342ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
55352024-12-13T21:05:38.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55362024-12-13T21:05:38.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55372024-12-13T21:05:38.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55382024-12-13T21:05:38.346ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0aadc1-94e7-4dff-9add-6715fb5dea63", "content-length": "2", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
55392024-12-13T21:05:38.346ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55402024-12-13T21:05:38.346ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "94a44431-518c-48ce-9144-bf27b530d549", "content-length": "52", "date": "Fri, 13 Dec 2024 21:05:37 GMT"} })
55412024-12-13T21:05:38.346ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
55422024-12-13T21:05:38.346ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55432024-12-13T21:05:38.469ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f7afee97-e021-465d-aa5a-b23853b4dd28", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} })
55442024-12-13T21:05:38.469ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
55452024-12-13T21:05:38.469ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55462024-12-13T21:05:38.469ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83afb0cd-c25c-4495-a392-cd68def7f32a", "content-length": "682", "date": "Fri, 13 Dec 2024 21:05:38 GMT"} })
55472024-12-13T21:05:38.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55482024-12-13T21:05:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55492024-12-13T21:05:38.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55502024-12-13T21:05:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55512024-12-13T21:05:38.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55522024-12-13T21:05:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55532024-12-13T21:05:38.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55542024-12-13T21:05:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55552024-12-13T21:05:38.487ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 762.979829ms iteration = 17 status = {}
55562024-12-13T21:05:38.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86f510b4-ac77-445e-9141-70fce21c724f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55572024-12-13T21:05:38.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86f510b4-ac77-445e-9141-70fce21c724f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55582024-12-13T21:05:38.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 86f510b4-ac77-445e-9141-70fce21c724f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55592024-12-13T21:05:39.109ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
55602024-12-13T21:05:39.109ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
55612024-12-13T21:05:39.140ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
55622024-12-13T21:05:39.140ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42279
55632024-12-13T21:05:39.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42279 req_id = 2867af63-687f-471f-853f-07d9b46729cc roles = RoleSet { roles: {} } uri = /metrics/producers
55642024-12-13T21:05:39.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42279 req_id = 2867af63-687f-471f-853f-07d9b46729cc resource = Database result = Ok(()) uri = /metrics/producers
55652024-12-13T21:05:39.150ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 0599e804-8800-4951-9d87-7a8a49a507a3
55662024-12-13T21:05:39.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10220 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42279 req_id = 2867af63-687f-471f-853f-07d9b46729cc response_code = 201 uri = /metrics/producers
55672024-12-13T21:05:39.150ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2867af63-687f-471f-853f-07d9b46729cc", "content-length": "41", "date": "Fri, 13 Dec 2024 21:05:39 GMT"} })
55682024-12-13T21:05:39.151ZDEBGnexus (producer-registration-task): registered with nexus successfully
55692024-12-13T21:05:39.151ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
55702024-12-13T21:05:39.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 60a01af3-8d39-441c-9f8c-a584536346b9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55712024-12-13T21:05:39.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 60a01af3-8d39-441c-9f8c-a584536346b9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55722024-12-13T21:05:39.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 60a01af3-8d39-441c-9f8c-a584536346b9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55732024-12-13T21:05:39.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8ead3e1-28d9-4713-9a1f-22e6f48c30bd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55742024-12-13T21:05:39.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8ead3e1-28d9-4713-9a1f-22e6f48c30bd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55752024-12-13T21:05:39.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f8ead3e1-28d9-4713-9a1f-22e6f48c30bd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55762024-12-13T21:05:40.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b3039e2-32b4-4cb0-9717-4a1103042e6d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55772024-12-13T21:05:40.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b3039e2-32b4-4cb0-9717-4a1103042e6d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55782024-12-13T21:05:40.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3b3039e2-32b4-4cb0-9717-4a1103042e6d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55792024-12-13T21:05:41.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 48194226-3709-479d-b524-474b48afc07a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55802024-12-13T21:05:41.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 48194226-3709-479d-b524-474b48afc07a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55812024-12-13T21:05:41.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 48194226-3709-479d-b524-474b48afc07a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55822024-12-13T21:05:42.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 743562ee-ecb2-446c-aa45-aae2de5aa245 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55832024-12-13T21:05:42.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 743562ee-ecb2-446c-aa45-aae2de5aa245 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55842024-12-13T21:05:42.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 743562ee-ecb2-446c-aa45-aae2de5aa245 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55852024-12-13T21:05:43.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3858cd97-6614-47ac-b1a4-b77957593667 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55862024-12-13T21:05:43.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3858cd97-6614-47ac-b1a4-b77957593667 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55872024-12-13T21:05:43.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3858cd97-6614-47ac-b1a4-b77957593667 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55882024-12-13T21:05:44.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 522b4fc6-f816-45e0-8c72-1fc0ae21276b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55892024-12-13T21:05:44.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 522b4fc6-f816-45e0-8c72-1fc0ae21276b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55902024-12-13T21:05:44.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 522b4fc6-f816-45e0-8c72-1fc0ae21276b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55912024-12-13T21:05:45.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 561422ff-83c3-435a-a2bc-726ee6797bf7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55922024-12-13T21:05:45.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 561422ff-83c3-435a-a2bc-726ee6797bf7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55932024-12-13T21:05:45.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 561422ff-83c3-435a-a2bc-726ee6797bf7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55942024-12-13T21:05:46.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c8d3151a-567e-4d5d-9f6b-e48f8fa3b2e0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55952024-12-13T21:05:46.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c8d3151a-567e-4d5d-9f6b-e48f8fa3b2e0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55962024-12-13T21:05:46.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c8d3151a-567e-4d5d-9f6b-e48f8fa3b2e0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
55972024-12-13T21:05:47.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e901921d-4f50-4e83-9a29-3eba5a645322 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
55982024-12-13T21:05:47.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
55992024-12-13T21:05:47.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56002024-12-13T21:05:47.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
56012024-12-13T21:05:47.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56022024-12-13T21:05:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56032024-12-13T21:05:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56042024-12-13T21:05:47.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56052024-12-13T21:05:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56062024-12-13T21:05:47.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56072024-12-13T21:05:47.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.895691ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56082024-12-13T21:05:47.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56092024-12-13T21:05:47.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56102024-12-13T21:05:47.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56112024-12-13T21:05:47.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56122024-12-13T21:05:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56132024-12-13T21:05:47.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56142024-12-13T21:05:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
56152024-12-13T21:05:47.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56162024-12-13T21:05:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56172024-12-13T21:05:47.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
56182024-12-13T21:05:47.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.533014ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
56192024-12-13T21:05:47.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4b18bd32-bb36-4afa-8c77-d0792d1b925a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56202024-12-13T21:05:47.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4b18bd32-bb36-4afa-8c77-d0792d1b925a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56212024-12-13T21:05:47.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4b18bd32-bb36-4afa-8c77-d0792d1b925a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56222024-12-13T21:05:48.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9bfe2709-76fd-46ad-8e33-51659370105c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56232024-12-13T21:05:48.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9bfe2709-76fd-46ad-8e33-51659370105c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56242024-12-13T21:05:48.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9bfe2709-76fd-46ad-8e33-51659370105c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56252024-12-13T21:05:49.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d7b144b-cdad-455d-84eb-8ddc36ed55ab roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56262024-12-13T21:05:49.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d7b144b-cdad-455d-84eb-8ddc36ed55ab resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56272024-12-13T21:05:49.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d7b144b-cdad-455d-84eb-8ddc36ed55ab response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56282024-12-13T21:05:50.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4c0296d7-b2b8-40a8-af7b-797b1ec4e4e5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56292024-12-13T21:05:50.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4c0296d7-b2b8-40a8-af7b-797b1ec4e4e5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56302024-12-13T21:05:50.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4c0296d7-b2b8-40a8-af7b-797b1ec4e4e5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56312024-12-13T21:05:51.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e506c4af-9c7e-4e47-92bf-ec84b0bbd621 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56322024-12-13T21:05:51.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e506c4af-9c7e-4e47-92bf-ec84b0bbd621 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56332024-12-13T21:05:51.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e506c4af-9c7e-4e47-92bf-ec84b0bbd621 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56342024-12-13T21:05:52.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f859ec66-615d-4ebd-bc53-5ab296780dcb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56352024-12-13T21:05:52.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f859ec66-615d-4ebd-bc53-5ab296780dcb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56362024-12-13T21:05:52.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f859ec66-615d-4ebd-bc53-5ab296780dcb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56372024-12-13T21:05:53.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 755e61b8-0c47-4ef6-8bcb-c2cb33158fb3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56382024-12-13T21:05:53.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 755e61b8-0c47-4ef6-8bcb-c2cb33158fb3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56392024-12-13T21:05:53.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 755e61b8-0c47-4ef6-8bcb-c2cb33158fb3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56402024-12-13T21:05:54.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d9e2db8-f934-4b27-aa03-768251edded7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56412024-12-13T21:05:54.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d9e2db8-f934-4b27-aa03-768251edded7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56422024-12-13T21:05:54.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d9e2db8-f934-4b27-aa03-768251edded7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56432024-12-13T21:05:55.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b1d882b8-c19b-4e94-9960-d4d3472e9150 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56442024-12-13T21:05:55.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b1d882b8-c19b-4e94-9960-d4d3472e9150 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56452024-12-13T21:05:55.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b1d882b8-c19b-4e94-9960-d4d3472e9150 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56462024-12-13T21:05:57.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad32073d-a3e6-49bc-bc4a-94a49893624a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56472024-12-13T21:05:57.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad32073d-a3e6-49bc-bc4a-94a49893624a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56482024-12-13T21:05:57.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad32073d-a3e6-49bc-bc4a-94a49893624a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56492024-12-13T21:05:57.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 378074c1-d070-4ad0-881d-336c1432ef84 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
56502024-12-13T21:05:57.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
56512024-12-13T21:05:57.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56522024-12-13T21:05:57.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
56532024-12-13T21:05:57.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56542024-12-13T21:05:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56552024-12-13T21:05:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56562024-12-13T21:05:57.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56572024-12-13T21:05:57.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56582024-12-13T21:05:57.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56592024-12-13T21:05:57.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.220564ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56602024-12-13T21:05:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56612024-12-13T21:05:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56622024-12-13T21:05:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56632024-12-13T21:05:57.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56642024-12-13T21:05:57.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56652024-12-13T21:05:57.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662024-12-13T21:05:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
56672024-12-13T21:05:57.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56682024-12-13T21:05:57.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56692024-12-13T21:05:57.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
56702024-12-13T21:05:57.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.147882ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
56712024-12-13T21:05:58.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b46404c3-f097-4f6b-b6d8-33a87e5f38b5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56722024-12-13T21:05:58.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b46404c3-f097-4f6b-b6d8-33a87e5f38b5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56732024-12-13T21:05:58.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b46404c3-f097-4f6b-b6d8-33a87e5f38b5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56742024-12-13T21:05:59.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9789fd0-ef30-4bb9-9a39-9732876bf50f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56752024-12-13T21:05:59.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9789fd0-ef30-4bb9-9a39-9732876bf50f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56762024-12-13T21:05:59.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9789fd0-ef30-4bb9-9a39-9732876bf50f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56772024-12-13T21:06:00.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e67186d4-0d75-4b9b-b353-285a72042ea1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56782024-12-13T21:06:00.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e67186d4-0d75-4b9b-b353-285a72042ea1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56792024-12-13T21:06:00.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e67186d4-0d75-4b9b-b353-285a72042ea1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56802024-12-13T21:06:01.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 018be145-8187-4564-8d12-bc38d6a7241d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56812024-12-13T21:06:01.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 018be145-8187-4564-8d12-bc38d6a7241d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56822024-12-13T21:06:01.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 018be145-8187-4564-8d12-bc38d6a7241d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56832024-12-13T21:06:02.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3d5c53fa-eecf-44c4-9484-373a2559bc31 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56842024-12-13T21:06:02.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3d5c53fa-eecf-44c4-9484-373a2559bc31 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56852024-12-13T21:06:02.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3d5c53fa-eecf-44c4-9484-373a2559bc31 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56862024-12-13T21:06:03.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3aee4c97-30c6-40ec-a226-8232fe268597 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56872024-12-13T21:06:03.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3aee4c97-30c6-40ec-a226-8232fe268597 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56882024-12-13T21:06:03.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3aee4c97-30c6-40ec-a226-8232fe268597 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56892024-12-13T21:06:04.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f614e13f-09e9-42bf-aaa0-b11a4e1da885 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56902024-12-13T21:06:04.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f614e13f-09e9-42bf-aaa0-b11a4e1da885 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56912024-12-13T21:06:04.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f614e13f-09e9-42bf-aaa0-b11a4e1da885 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56922024-12-13T21:06:05.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cae47269-be45-4c17-9e11-f78a8281e415 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56932024-12-13T21:06:05.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cae47269-be45-4c17-9e11-f78a8281e415 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56942024-12-13T21:06:05.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cae47269-be45-4c17-9e11-f78a8281e415 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56952024-12-13T21:06:06.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6115c1a4-475e-4f7e-9735-81c19aa11992 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56962024-12-13T21:06:06.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6115c1a4-475e-4f7e-9735-81c19aa11992 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56972024-12-13T21:06:06.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6115c1a4-475e-4f7e-9735-81c19aa11992 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56982024-12-13T21:06:07.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a67417e-ec1c-4781-81b8-593b7f595b4e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
56992024-12-13T21:06:07.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a67417e-ec1c-4781-81b8-593b7f595b4e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
57002024-12-13T21:06:07.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a67417e-ec1c-4781-81b8-593b7f595b4e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
57012024-12-13T21:06:07.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1324 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e02c0e2d-ab6a-4a2b-bdd2-2a7fae7d4122 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
57022024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
57032024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
57042024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57052024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
57062024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57072024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
57092024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57102024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
57112024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
57122024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57132024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
57142024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57152024-12-13T21:06:07.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57162024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
57172024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57182024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57192024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57202024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
57212024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
57222024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57232024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
57242024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
57252024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
57262024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57272024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57282024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57292024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57302024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57312024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57322024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57332024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57342024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57352024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57362024-12-13T21:06:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57372024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57382024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57392024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57402024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57412024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
57422024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
57432024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57442024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57452024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
57462024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57472024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
57482024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57492024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57502024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57512024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57522024-12-13T21:06:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57532024-12-13T21:06:07.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-12-13T21:06:07.726ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.626988ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57552024-12-13T21:06:07.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57562024-12-13T21:06:07.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57572024-12-13T21:06:07.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57582024-12-13T21:06:07.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1409, tv_nsec: 241991330 } })
57592024-12-13T21:06:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57602024-12-13T21:06:07.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57612024-12-13T21:06:07.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
57622024-12-13T21:06:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57632024-12-13T21:06:07.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57642024-12-13T21:06:07.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57652024-12-13T21:06:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57662024-12-13T21:06:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57672024-12-13T21:06:07.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57682024-12-13T21:06:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57692024-12-13T21:06:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57702024-12-13T21:06:07.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57712024-12-13T21:06:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57722024-12-13T21:06:07.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732024-12-13T21:06:07.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57742024-12-13T21:06:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57752024-12-13T21:06:07.732ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57762024-12-13T21:06:07.732ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57772024-12-13T21:06:07.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57782024-12-13T21:06:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57792024-12-13T21:06:07.733ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1409, tv_nsec: 246925208 } })
57802024-12-13T21:06:07.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
57812024-12-13T21:06:07.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-12-13T21:06:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57832024-12-13T21:06:07.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57842024-12-13T21:06:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57852024-12-13T21:06:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57862024-12-13T21:06:07.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57872024-12-13T21:06:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57882024-12-13T21:06:07.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.977651ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
57892024-12-13T21:06:07.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57902024-12-13T21:06:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57912024-12-13T21:06:07.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-12-13T21:06:07.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57932024-12-13T21:06:07.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57942024-12-13T21:06:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57952024-12-13T21:06:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57962024-12-13T21:06:07.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1409, tv_nsec: 252752319 } })
57972024-12-13T21:06:07.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57982024-12-13T21:06:07.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.80025ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57992024-12-13T21:06:07.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
58002024-12-13T21:06:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58012024-12-13T21:06:07.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58022024-12-13T21:06:07.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58032024-12-13T21:06:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58042024-12-13T21:06:07.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58052024-12-13T21:06:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58062024-12-13T21:06:07.740ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58072024-12-13T21:06:07.740ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58082024-12-13T21:06:07.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58092024-12-13T21:06:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58102024-12-13T21:06:07.742ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58112024-12-13T21:06:07.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58122024-12-13T21:06:07.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58132024-12-13T21:06:07.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58142024-12-13T21:06:07.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58152024-12-13T21:06:07.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.216372ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58162024-12-13T21:06:07.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
58172024-12-13T21:06:07.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58182024-12-13T21:06:07.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58192024-12-13T21:06:07.746ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58202024-12-13T21:06:07.746ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.076568ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58212024-12-13T21:06:07.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58222024-12-13T21:06:07.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58232024-12-13T21:06:07.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58242024-12-13T21:06:07.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58252024-12-13T21:06:07.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
58262024-12-13T21:06:07.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.344695ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
58272024-12-13T21:06:07.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58282024-12-13T21:06:07.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58292024-12-13T21:06:07.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58302024-12-13T21:06:07.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.566122ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58312024-12-13T21:06:07.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58322024-12-13T21:06:07.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.394664ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
58332024-12-13T21:06:07.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58342024-12-13T21:06:07.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58352024-12-13T21:06:07.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58362024-12-13T21:06:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
58372024-12-13T21:06:07.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58382024-12-13T21:06:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58392024-12-13T21:06:07.771ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.677562ms iteration = 18 status = 0
58402024-12-13T21:06:07.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 47.640956ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58412024-12-13T21:06:07.775ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58422024-12-13T21:06:07.775ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58432024-12-13T21:06:07.775ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.302946ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58442024-12-13T21:06:07.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58452024-12-13T21:06:07.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58462024-12-13T21:06:07.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472024-12-13T21:06:07.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58482024-12-13T21:06:07.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58492024-12-13T21:06:07.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58502024-12-13T21:06:07.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512024-12-13T21:06:07.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58522024-12-13T21:06:07.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58532024-12-13T21:06:07.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58542024-12-13T21:06:07.823ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58552024-12-13T21:06:07.823ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58562024-12-13T21:06:07.824ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b84366d6-0b67-4315-8c72-16b0cae95136", "content-length": "26", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58572024-12-13T21:06:07.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58582024-12-13T21:06:07.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58592024-12-13T21:06:07.843ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.773257ms iteration = 21 status = {"physical_disks_added":0}
58602024-12-13T21:06:07.932ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58612024-12-13T21:06:07.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dc0b5d3-4ac0-4c82-93f1-3e5b400bdd94", "content-length": "691", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58622024-12-13T21:06:07.933ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58632024-12-13T21:06:07.933ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58642024-12-13T21:06:07.933ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58652024-12-13T21:06:07.934ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 211.442955ms iteration = 18 status = {}
58662024-12-13T21:06:07.969ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58672024-12-13T21:06:07.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58682024-12-13T21:06:07.969ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58692024-12-13T21:06:07.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e725142-748f-4909-9965-a7b529bf5404", "content-length": "372", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58702024-12-13T21:06:07.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58712024-12-13T21:06:07.969ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8c09e90-088b-4e9d-b0b7-147bae5c0527", "content-length": "1", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58722024-12-13T21:06:07.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58732024-12-13T21:06:07.972ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58742024-12-13T21:06:07.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58752024-12-13T21:06:07.973ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.57795ms iteration = 18 status = null
58762024-12-13T21:06:07.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58772024-12-13T21:06:07.979ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58782024-12-13T21:06:07.979ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed8197a-19d5-4db9-9406-25ec0dbad47d", "content-length": "26", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58792024-12-13T21:06:07.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58802024-12-13T21:06:07.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
58812024-12-13T21:06:07.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58822024-12-13T21:06:07.980ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "734bfbe9-faee-432a-85d6-3a928a83fb9e", "content-length": "26", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58832024-12-13T21:06:07.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58842024-12-13T21:06:07.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58852024-12-13T21:06:07.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
58862024-12-13T21:06:07.984ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58872024-12-13T21:06:07.984ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58882024-12-13T21:06:07.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c6d2eabf-7498-461f-a7d0-826834fa316d", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58892024-12-13T21:06:07.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58902024-12-13T21:06:07.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58912024-12-13T21:06:07.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58922024-12-13T21:06:07.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58932024-12-13T21:06:07.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58942024-12-13T21:06:07.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58952024-12-13T21:06:07.998ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58962024-12-13T21:06:07.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58972024-12-13T21:06:07.998ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5ed9b53e-0353-49b4-90b2-a1b872f65ba4", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
58982024-12-13T21:06:08.000ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.278952ms iteration = 19 status = {}
58992024-12-13T21:06:08.033ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.760235ms iteration = 18 status = {}
59002024-12-13T21:06:08.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59012024-12-13T21:06:08.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59022024-12-13T21:06:08.088ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
59032024-12-13T21:06:08.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59042024-12-13T21:06:08.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59052024-12-13T21:06:08.097ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59062024-12-13T21:06:08.097ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e19e3fd1-041b-41c1-809d-741e81d58760", "content-length": "134", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
59072024-12-13T21:06:08.097ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59082024-12-13T21:06:08.097ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
59092024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59102024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59112024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59122024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59132024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59142024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59152024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59162024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59172024-12-13T21:06:08.098ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
59182024-12-13T21:06:08.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59192024-12-13T21:06:08.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59202024-12-13T21:06:08.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59212024-12-13T21:06:08.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0970e0c1-1b59-4037-84f1-5f90910a1fc9", "content-length": "2", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
59222024-12-13T21:06:08.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59232024-12-13T21:06:08.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c5f15c4-292d-47cd-9d92-836d8b9e803e", "content-length": "52", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
59242024-12-13T21:06:08.101ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
59252024-12-13T21:06:08.101ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59262024-12-13T21:06:08.188ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e9364612-9312-4c8e-821a-b0e1a622d6db", "date": "Fri, 13 Dec 2024 21:06:07 GMT"} })
59272024-12-13T21:06:08.188ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
59282024-12-13T21:06:08.188ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59292024-12-13T21:06:08.188ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8796ed2-aa5d-4945-acf7-ab51291e8991", "content-length": "682", "date": "Fri, 13 Dec 2024 21:06:08 GMT"} })
59302024-12-13T21:06:08.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59312024-12-13T21:06:08.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59322024-12-13T21:06:08.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59332024-12-13T21:06:08.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59342024-12-13T21:06:08.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59352024-12-13T21:06:08.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59362024-12-13T21:06:08.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59372024-12-13T21:06:08.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59382024-12-13T21:06:08.205ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.730945ms iteration = 18 status = {}
59392024-12-13T21:06:08.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dcf5b8e9-ebcd-4070-b818-b5e5fa56a8cf roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59402024-12-13T21:06:08.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dcf5b8e9-ebcd-4070-b818-b5e5fa56a8cf resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59412024-12-13T21:06:08.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dcf5b8e9-ebcd-4070-b818-b5e5fa56a8cf response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59422024-12-13T21:06:08.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = c3832f70-a913-4aca-b41c-ca7e26974cd1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59432024-12-13T21:06:08.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = c3832f70-a913-4aca-b41c-ca7e26974cd1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59442024-12-13T21:06:08.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = c3832f70-a913-4aca-b41c-ca7e26974cd1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59452024-12-13T21:06:09.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5a1d14da-24b5-485b-ba21-a88941e8577a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59462024-12-13T21:06:09.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5a1d14da-24b5-485b-ba21-a88941e8577a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59472024-12-13T21:06:09.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5a1d14da-24b5-485b-ba21-a88941e8577a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59482024-12-13T21:06:10.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a4b7c6bf-42e6-4d19-bf82-8da5f95b1406 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59492024-12-13T21:06:10.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a4b7c6bf-42e6-4d19-bf82-8da5f95b1406 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59502024-12-13T21:06:10.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a4b7c6bf-42e6-4d19-bf82-8da5f95b1406 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59512024-12-13T21:06:11.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 65dd018e-f642-4126-8888-bb6074a86ded roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59522024-12-13T21:06:11.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 65dd018e-f642-4126-8888-bb6074a86ded resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59532024-12-13T21:06:11.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 65dd018e-f642-4126-8888-bb6074a86ded response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59542024-12-13T21:06:12.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1dd2cd08-e375-4488-9f95-d96ba17b0680 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59552024-12-13T21:06:12.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1dd2cd08-e375-4488-9f95-d96ba17b0680 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59562024-12-13T21:06:12.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1dd2cd08-e375-4488-9f95-d96ba17b0680 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59572024-12-13T21:06:13.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 20c937b0-c828-4a2c-bfe7-22d0db43d165 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59582024-12-13T21:06:13.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 20c937b0-c828-4a2c-bfe7-22d0db43d165 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59592024-12-13T21:06:13.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 20c937b0-c828-4a2c-bfe7-22d0db43d165 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59602024-12-13T21:06:14.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1891534c-1325-4ca4-9d35-603a0bb43a15 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59612024-12-13T21:06:14.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1891534c-1325-4ca4-9d35-603a0bb43a15 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59622024-12-13T21:06:14.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1891534c-1325-4ca4-9d35-603a0bb43a15 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59632024-12-13T21:06:15.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd6438f1-75b3-49cd-bbb2-6e18daab74c3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59642024-12-13T21:06:15.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd6438f1-75b3-49cd-bbb2-6e18daab74c3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59652024-12-13T21:06:15.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fd6438f1-75b3-49cd-bbb2-6e18daab74c3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59662024-12-13T21:06:16.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a95e385b-6ce3-4dc7-8a65-a96f48b29c47 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59672024-12-13T21:06:16.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a95e385b-6ce3-4dc7-8a65-a96f48b29c47 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59682024-12-13T21:06:16.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a95e385b-6ce3-4dc7-8a65-a96f48b29c47 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59692024-12-13T21:06:17.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eb9be9fd-420d-4e5a-89d7-90611a43ccba roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59702024-12-13T21:06:17.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eb9be9fd-420d-4e5a-89d7-90611a43ccba resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59712024-12-13T21:06:17.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eb9be9fd-420d-4e5a-89d7-90611a43ccba response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
59722024-12-13T21:06:17.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c324fd87-6a4d-45d4-88a6-e79cf787f408 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
59732024-12-13T21:06:17.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c324fd87-6a4d-45d4-88a6-e79cf787f408 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
59742024-12-13T21:06:17.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c324fd87-6a4d-45d4-88a6-e79cf787f408 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
59752024-12-13T21:06:17.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 03755592-28f4-4f3f-8314-a224e90f23e5 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
59762024-12-13T21:06:17.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 03755592-28f4-4f3f-8314-a224e90f23e5 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
59772024-12-13T21:06:17.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 03755592-28f4-4f3f-8314-a224e90f23e5 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
59782024-12-13T21:06:17.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1265 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2178258a-0762-43e1-bf22-b9d56484a1d0 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
59792024-12-13T21:06:17.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
59802024-12-13T21:06:17.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59812024-12-13T21:06:17.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
59822024-12-13T21:06:17.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59832024-12-13T21:06:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59842024-12-13T21:06:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59852024-12-13T21:06:17.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59862024-12-13T21:06:17.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59872024-12-13T21:06:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59882024-12-13T21:06:17.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.789018ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59892024-12-13T21:06:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59902024-12-13T21:06:17.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59912024-12-13T21:06:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59922024-12-13T21:06:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59932024-12-13T21:06:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59942024-12-13T21:06:17.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59952024-12-13T21:06:17.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
59962024-12-13T21:06:17.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59972024-12-13T21:06:17.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59982024-12-13T21:06:17.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
59992024-12-13T21:06:17.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.251679ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
60002024-12-13T21:06:18.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0026153a-e19a-41c7-be24-a799538ada85 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60012024-12-13T21:06:18.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0026153a-e19a-41c7-be24-a799538ada85 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60022024-12-13T21:06:18.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0026153a-e19a-41c7-be24-a799538ada85 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60032024-12-13T21:06:19.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e08886f6-2ee2-4723-bf0a-22729447b091 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60042024-12-13T21:06:19.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e08886f6-2ee2-4723-bf0a-22729447b091 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60052024-12-13T21:06:19.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e08886f6-2ee2-4723-bf0a-22729447b091 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60062024-12-13T21:06:20.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 93c58127-60af-497a-bda7-22fac94c636b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60072024-12-13T21:06:20.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 93c58127-60af-497a-bda7-22fac94c636b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60082024-12-13T21:06:20.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 93c58127-60af-497a-bda7-22fac94c636b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60092024-12-13T21:06:21.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 72204b37-4098-446a-b87a-dd6911d9f8e3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60102024-12-13T21:06:21.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 72204b37-4098-446a-b87a-dd6911d9f8e3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60112024-12-13T21:06:21.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 72204b37-4098-446a-b87a-dd6911d9f8e3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60122024-12-13T21:06:22.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5fdec074-aded-41e7-b192-1f77a169e426 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60132024-12-13T21:06:22.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5fdec074-aded-41e7-b192-1f77a169e426 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60142024-12-13T21:06:22.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5fdec074-aded-41e7-b192-1f77a169e426 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60152024-12-13T21:06:23.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 250906d5-b3d9-4f51-8fc5-39ca94f03307 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60162024-12-13T21:06:23.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 250906d5-b3d9-4f51-8fc5-39ca94f03307 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60172024-12-13T21:06:23.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 250906d5-b3d9-4f51-8fc5-39ca94f03307 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60182024-12-13T21:06:24.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7b2ce218-f16b-4a31-97ae-13ddd6e495b4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60192024-12-13T21:06:24.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7b2ce218-f16b-4a31-97ae-13ddd6e495b4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60202024-12-13T21:06:24.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7b2ce218-f16b-4a31-97ae-13ddd6e495b4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60212024-12-13T21:06:25.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bee89d4a-b6e3-453d-b296-ba6b87e648cd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60222024-12-13T21:06:25.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bee89d4a-b6e3-453d-b296-ba6b87e648cd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60232024-12-13T21:06:25.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bee89d4a-b6e3-453d-b296-ba6b87e648cd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60242024-12-13T21:06:26.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f21ac21-6f30-4add-bc7e-17676329c6db roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60252024-12-13T21:06:26.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f21ac21-6f30-4add-bc7e-17676329c6db resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60262024-12-13T21:06:26.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f21ac21-6f30-4add-bc7e-17676329c6db response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60272024-12-13T21:06:27.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 3df19154-a087-420c-8d88-1fb1653f3f32 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
60282024-12-13T21:06:27.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fd6e0a8-0966-446e-b9dd-4b6f20115e8a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60292024-12-13T21:06:27.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fd6e0a8-0966-446e-b9dd-4b6f20115e8a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60302024-12-13T21:06:27.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6fd6e0a8-0966-446e-b9dd-4b6f20115e8a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60312024-12-13T21:06:27.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
60322024-12-13T21:06:27.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
60332024-12-13T21:06:27.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60342024-12-13T21:06:27.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60352024-12-13T21:06:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60362024-12-13T21:06:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60372024-12-13T21:06:27.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60382024-12-13T21:06:27.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60392024-12-13T21:06:27.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60402024-12-13T21:06:27.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.031585ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60412024-12-13T21:06:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60422024-12-13T21:06:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60432024-12-13T21:06:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60442024-12-13T21:06:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60452024-12-13T21:06:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60462024-12-13T21:06:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60472024-12-13T21:06:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
60482024-12-13T21:06:27.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60492024-12-13T21:06:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60502024-12-13T21:06:27.741ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
60512024-12-13T21:06:27.741ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.558505ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
60522024-12-13T21:06:28.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 555774d5-9967-41f3-bfbe-62d023b2c9ec roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60532024-12-13T21:06:28.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 555774d5-9967-41f3-bfbe-62d023b2c9ec resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60542024-12-13T21:06:28.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 555774d5-9967-41f3-bfbe-62d023b2c9ec response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60552024-12-13T21:06:29.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e8749de-48e3-45e2-8ab6-d17c460c5967 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60562024-12-13T21:06:29.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e8749de-48e3-45e2-8ab6-d17c460c5967 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60572024-12-13T21:06:29.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e8749de-48e3-45e2-8ab6-d17c460c5967 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60582024-12-13T21:06:30.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e5a27c1-4f98-4b30-863f-4e6078f8879d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60592024-12-13T21:06:30.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e5a27c1-4f98-4b30-863f-4e6078f8879d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60602024-12-13T21:06:30.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e5a27c1-4f98-4b30-863f-4e6078f8879d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60612024-12-13T21:06:31.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d8d7f02a-b1ab-4433-a407-b3475a40b2cf roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60622024-12-13T21:06:31.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d8d7f02a-b1ab-4433-a407-b3475a40b2cf resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60632024-12-13T21:06:31.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d8d7f02a-b1ab-4433-a407-b3475a40b2cf response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60642024-12-13T21:06:32.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 88472fa4-d7c4-4bd3-b8a1-7f819817a780 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
60652024-12-13T21:06:32.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 88472fa4-d7c4-4bd3-b8a1-7f819817a780 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
60662024-12-13T21:06:32.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 88472fa4-d7c4-4bd3-b8a1-7f819817a780 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
60672024-12-13T21:06:32.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 7414470b-1a66-4e5f-a192-8094a3afddad roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
60682024-12-13T21:06:32.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 7414470b-1a66-4e5f-a192-8094a3afddad resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
60692024-12-13T21:06:32.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 7414470b-1a66-4e5f-a192-8094a3afddad response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
60702024-12-13T21:06:32.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cc7a7db4-b297-48d1-874a-9e2f6879d070 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60712024-12-13T21:06:32.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cc7a7db4-b297-48d1-874a-9e2f6879d070 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60722024-12-13T21:06:32.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cc7a7db4-b297-48d1-874a-9e2f6879d070 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60732024-12-13T21:06:33.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7d3fc886-288a-4d70-8832-c054d1b47285 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60742024-12-13T21:06:33.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7d3fc886-288a-4d70-8832-c054d1b47285 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60752024-12-13T21:06:33.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7d3fc886-288a-4d70-8832-c054d1b47285 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60762024-12-13T21:06:34.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82fcfc77-1c1b-4f5d-a85e-7a979cbbe445 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60772024-12-13T21:06:34.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82fcfc77-1c1b-4f5d-a85e-7a979cbbe445 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60782024-12-13T21:06:34.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82fcfc77-1c1b-4f5d-a85e-7a979cbbe445 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60792024-12-13T21:06:35.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9a0462d6-09c7-466b-82c6-62b5a5b9328e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60802024-12-13T21:06:35.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9a0462d6-09c7-466b-82c6-62b5a5b9328e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60812024-12-13T21:06:35.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9a0462d6-09c7-466b-82c6-62b5a5b9328e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60822024-12-13T21:06:36.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a4db3dea-8f31-47e9-8aa2-d544a5b47fe3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60832024-12-13T21:06:36.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a4db3dea-8f31-47e9-8aa2-d544a5b47fe3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60842024-12-13T21:06:36.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a4db3dea-8f31-47e9-8aa2-d544a5b47fe3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
60852024-12-13T21:06:37.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1201 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2a7e37c7-2a80-40b5-bb03-673ac0193e59 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
60862024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
60872024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60882024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
60892024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
60902024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
60912024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60922024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60932024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
60942024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
60952024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
60962024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
60972024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60982024-12-13T21:06:37.723ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
60992024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61002024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.5\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
61012024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61022024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
61032024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
61042024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61052024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
61062024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
61072024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61082024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61092024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
61102024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
61112024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61122024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
61132024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61142024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61152024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
61162024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61172024-12-13T21:06:37.723ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
61182024-12-13T21:06:37.724ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:56:37.723936690 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61192024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61202024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
61212024-12-13T21:06:37.724ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61222024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61232024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
61242024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
61252024-12-13T21:06:37.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61262024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61272024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
61282024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61292024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
61302024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61312024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
61322024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61332024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61342024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
61352024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61362024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
61372024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61382024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
61392024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
61402024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61412024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61422024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
61432024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61442024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
61452024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61462024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
61472024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
61482024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61492024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61502024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61512024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61522024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61532024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61542024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61552024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61562024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61572024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61582024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61592024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61602024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61612024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61622024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61632024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61642024-12-13T21:06:37.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 238530603 } })
61652024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61662024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61672024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61682024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61692024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61702024-12-13T21:06:37.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 238607915 } })
61712024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61722024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61732024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61742024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61752024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61762024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61772024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61782024-12-13T21:06:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61792024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61802024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
61812024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.252332ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
61822024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
61832024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.266893ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
61842024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61852024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61862024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61872024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61882024-12-13T21:06:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61892024-12-13T21:06:37.726ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.811473ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61902024-12-13T21:06:37.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61912024-12-13T21:06:37.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61922024-12-13T21:06:37.729ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61932024-12-13T21:06:37.729ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61942024-12-13T21:06:37.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61952024-12-13T21:06:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61962024-12-13T21:06:37.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61972024-12-13T21:06:37.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61982024-12-13T21:06:37.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61992024-12-13T21:06:37.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 245313099 } })
62002024-12-13T21:06:37.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62012024-12-13T21:06:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62022024-12-13T21:06:37.731ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62032024-12-13T21:06:37.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042024-12-13T21:06:37.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62052024-12-13T21:06:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62062024-12-13T21:06:37.733ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:56:37.723936690 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62072024-12-13T21:06:37.733ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.752633ms iteration = 10 status = {"expiration":"2024-12-13T20:56:37.723936690Z","pruned":[]}
62082024-12-13T21:06:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62092024-12-13T21:06:37.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62102024-12-13T21:06:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62112024-12-13T21:06:37.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62122024-12-13T21:06:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62132024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62142024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62152024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62162024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62172024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62182024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62192024-12-13T21:06:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62202024-12-13T21:06:37.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62212024-12-13T21:06:37.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62222024-12-13T21:06:37.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 251705514 } })
62232024-12-13T21:06:37.738ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62242024-12-13T21:06:37.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62252024-12-13T21:06:37.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62262024-12-13T21:06:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62272024-12-13T21:06:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62282024-12-13T21:06:37.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62292024-12-13T21:06:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62302024-12-13T21:06:37.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62312024-12-13T21:06:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62322024-12-13T21:06:37.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62332024-12-13T21:06:37.743ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62342024-12-13T21:06:37.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.889725ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
62352024-12-13T21:06:37.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62362024-12-13T21:06:37.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62372024-12-13T21:06:37.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62382024-12-13T21:06:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62392024-12-13T21:06:37.747ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62402024-12-13T21:06:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62412024-12-13T21:06:37.747ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62422024-12-13T21:06:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62432024-12-13T21:06:37.749ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.696726ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
62442024-12-13T21:06:37.751ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62452024-12-13T21:06:37.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62462024-12-13T21:06:37.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62472024-12-13T21:06:37.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62482024-12-13T21:06:37.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62492024-12-13T21:06:37.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62502024-12-13T21:06:37.757ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62512024-12-13T21:06:37.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62522024-12-13T21:06:37.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62532024-12-13T21:06:37.759ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62542024-12-13T21:06:37.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62552024-12-13T21:06:37.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62562024-12-13T21:06:37.760ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62572024-12-13T21:06:37.760ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.378644ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62582024-12-13T21:06:37.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 278121040 } })
62592024-12-13T21:06:37.764ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
62602024-12-13T21:06:37.765ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62612024-12-13T21:06:37.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62622024-12-13T21:06:37.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62632024-12-13T21:06:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62642024-12-13T21:06:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62652024-12-13T21:06:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62662024-12-13T21:06:37.768ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62672024-12-13T21:06:37.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62682024-12-13T21:06:37.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692024-12-13T21:06:37.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62702024-12-13T21:06:37.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62712024-12-13T21:06:37.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62722024-12-13T21:06:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62732024-12-13T21:06:37.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62742024-12-13T21:06:37.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62752024-12-13T21:06:37.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62762024-12-13T21:06:37.776ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62772024-12-13T21:06:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62782024-12-13T21:06:37.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.483264ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62792024-12-13T21:06:37.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-12-13T21:06:37.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62812024-12-13T21:06:37.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62822024-12-13T21:06:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
62832024-12-13T21:06:37.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62842024-12-13T21:06:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62852024-12-13T21:06:37.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62862024-12-13T21:06:37.790ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-12-13T21:06:37.790ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62882024-12-13T21:06:37.790ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62892024-12-13T21:06:37.790ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.853774ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62902024-12-13T21:06:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62912024-12-13T21:06:37.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.696968ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
62922024-12-13T21:06:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62932024-12-13T21:06:37.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62942024-12-13T21:06:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62952024-12-13T21:06:37.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62962024-12-13T21:06:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62972024-12-13T21:06:37.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62982024-12-13T21:06:37.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62992024-12-13T21:06:37.797ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63002024-12-13T21:06:37.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.290472ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63012024-12-13T21:06:37.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63022024-12-13T21:06:37.799ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63032024-12-13T21:06:37.799ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63042024-12-13T21:06:37.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63052024-12-13T21:06:37.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63062024-12-13T21:06:37.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63072024-12-13T21:06:37.800ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63082024-12-13T21:06:37.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63092024-12-13T21:06:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63102024-12-13T21:06:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.19976ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63112024-12-13T21:06:37.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63122024-12-13T21:06:37.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63132024-12-13T21:06:37.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63142024-12-13T21:06:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63152024-12-13T21:06:37.829ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63162024-12-13T21:06:37.829ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63172024-12-13T21:06:37.829ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63182024-12-13T21:06:37.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63192024-12-13T21:06:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63202024-12-13T21:06:37.839ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63212024-12-13T21:06:37.839ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63222024-12-13T21:06:37.839ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63232024-12-13T21:06:37.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63242024-12-13T21:06:37.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63252024-12-13T21:06:37.850ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63262024-12-13T21:06:37.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 126.293896ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63272024-12-13T21:06:37.865ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63282024-12-13T21:06:37.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63292024-12-13T21:06:37.902ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63302024-12-13T21:06:37.902ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab6eeabc-5969-46ae-9437-7ebbed89239d", "content-length": "26", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
63312024-12-13T21:06:37.902ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63322024-12-13T21:06:37.906ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63332024-12-13T21:06:37.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 16451276-3684-4348-8c2c-329e870a8f1c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
63342024-12-13T21:06:37.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 16451276-3684-4348-8c2c-329e870a8f1c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
63352024-12-13T21:06:37.964ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63362024-12-13T21:06:37.964ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63372024-12-13T21:06:37.965ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e275bd1-51ad-4034-aaba-71d37691ba99", "content-length": "26", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
63382024-12-13T21:06:37.965ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63392024-12-13T21:06:37.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63402024-12-13T21:06:37.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63412024-12-13T21:06:38.027ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63422024-12-13T21:06:38.027ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63432024-12-13T21:06:38.028ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9041f71-8a2a-4822-9539-0b1d18c89e11", "content-length": "372", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} })
63442024-12-13T21:06:38.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63452024-12-13T21:06:38.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63462024-12-13T21:06:38.034ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 310.505584ms iteration = 5 status = {"nsuccess":5}
63472024-12-13T21:06:38.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63482024-12-13T21:06:38.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63492024-12-13T21:06:38.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 16451276-3684-4348-8c2c-329e870a8f1c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
63502024-12-13T21:06:38.044ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63512024-12-13T21:06:38.044ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
63522024-12-13T21:06:38.044ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 320.37923ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
63532024-12-13T21:06:38.044ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e5acc8e1-570c-40f7-93ab-b770233822fd", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63542024-12-13T21:06:38.044ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63552024-12-13T21:06:38.046ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e71fbc98-1b89-49cf-8ae7-42c8291b212d", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63562024-12-13T21:06:38.046ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63572024-12-13T21:06:38.049ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63582024-12-13T21:06:38.049ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 325.466912ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63592024-12-13T21:06:38.057ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63602024-12-13T21:06:38.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63612024-12-13T21:06:38.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63622024-12-13T21:06:38.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63632024-12-13T21:06:38.065ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63642024-12-13T21:06:38.065ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63652024-12-13T21:06:38.065ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 341.241141ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63662024-12-13T21:06:38.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63672024-12-13T21:06:38.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
63682024-12-13T21:06:38.067ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63692024-12-13T21:06:38.068ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fb54b50-ae83-4b0f-8f59-1cd3b9a8925d", "content-length": "26", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
63702024-12-13T21:06:38.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63712024-12-13T21:06:38.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
63722024-12-13T21:06:38.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63732024-12-13T21:06:38.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63742024-12-13T21:06:38.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63752024-12-13T21:06:38.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63762024-12-13T21:06:38.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63772024-12-13T21:06:38.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63782024-12-13T21:06:38.089ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63792024-12-13T21:06:38.089ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63802024-12-13T21:06:38.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 365.988133ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63812024-12-13T21:06:38.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
63822024-12-13T21:06:38.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63832024-12-13T21:06:38.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63842024-12-13T21:06:38.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63852024-12-13T21:06:38.092ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 369.083393ms iteration = 19 status = 0
63862024-12-13T21:06:38.096ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 372.839871ms iteration = 19 status = {}
63872024-12-13T21:06:38.097ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63882024-12-13T21:06:38.097ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6dbebd4-5d15-42aa-9fec-770b14888886", "content-length": "1", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
63892024-12-13T21:06:38.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63902024-12-13T21:06:38.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63912024-12-13T21:06:38.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63922024-12-13T21:06:38.099ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63932024-12-13T21:06:38.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63942024-12-13T21:06:38.100ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
63952024-12-13T21:06:38.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63962024-12-13T21:06:38.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4991a3fe-2fc9-4ed1-a0c1-049980a50e47", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} })
63972024-12-13T21:06:38.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63982024-12-13T21:06:38.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63992024-12-13T21:06:38.101ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.731968ms iteration = 19 status = null
64002024-12-13T21:06:38.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64012024-12-13T21:06:38.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64022024-12-13T21:06:38.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64032024-12-13T21:06:38.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64042024-12-13T21:06:38.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64052024-12-13T21:06:38.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64062024-12-13T21:06:38.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64072024-12-13T21:06:38.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64082024-12-13T21:06:38.109ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64092024-12-13T21:06:38.109ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64102024-12-13T21:06:38.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "85ed5732-0c84-4abf-80a0-1b59317b00e6", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} })
64112024-12-13T21:06:38.111ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.777968ms iteration = 20 status = {}
64122024-12-13T21:06:38.113ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64132024-12-13T21:06:38.113ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
64142024-12-13T21:06:38.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64152024-12-13T21:06:38.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64162024-12-13T21:06:38.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172024-12-13T21:06:38.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 393.841816ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64182024-12-13T21:06:38.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64192024-12-13T21:06:38.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64202024-12-13T21:06:38.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64212024-12-13T21:06:38.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64222024-12-13T21:06:38.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64232024-12-13T21:06:38.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64242024-12-13T21:06:38.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64252024-12-13T21:06:38.126ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64262024-12-13T21:06:38.126ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64272024-12-13T21:06:38.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64282024-12-13T21:06:38.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64292024-12-13T21:06:38.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64302024-12-13T21:06:38.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64312024-12-13T21:06:38.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64322024-12-13T21:06:38.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64332024-12-13T21:06:38.135ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64342024-12-13T21:06:38.135ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64352024-12-13T21:06:38.135ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
64362024-12-13T21:06:38.135ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 411.061652ms iteration = 11 status = {"generation":1}
64372024-12-13T21:06:38.139ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
64382024-12-13T21:06:38.139ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 415.503377ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64392024-12-13T21:06:38.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64402024-12-13T21:06:38.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64412024-12-13T21:06:38.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64422024-12-13T21:06:38.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64432024-12-13T21:06:38.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64442024-12-13T21:06:38.146ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
64452024-12-13T21:06:38.147ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64462024-12-13T21:06:38.147ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
64472024-12-13T21:06:38.147ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 423.078674ms iteration = 11 status = {"generation":2}
64482024-12-13T21:06:38.160ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 436.313797ms iteration = 22 status = {"physical_disks_added":0}
64492024-12-13T21:06:38.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64502024-12-13T21:06:38.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0cf29646-18fc-4abf-afd5-e144c47b38be", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64512024-12-13T21:06:38.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64522024-12-13T21:06:38.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b1006101-8b26-4f88-a571-f037bfdd0be9", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64532024-12-13T21:06:38.212ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64542024-12-13T21:06:38.213ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "86ac1fda-278c-4ea0-a6dd-9ca9c94d77f6", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64552024-12-13T21:06:38.213ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64562024-12-13T21:06:38.215ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64572024-12-13T21:06:38.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 492.051523ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64582024-12-13T21:06:38.248ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64592024-12-13T21:06:38.248ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e56f2f2-a3a0-4b39-866a-04b9a62030aa", "content-length": "691", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} })
64602024-12-13T21:06:38.248ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64612024-12-13T21:06:38.248ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64622024-12-13T21:06:38.248ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64632024-12-13T21:06:38.249ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 526.028104ms iteration = 19 status = {}
64642024-12-13T21:06:38.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64652024-12-13T21:06:38.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64662024-12-13T21:06:38.259ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
64672024-12-13T21:06:38.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64682024-12-13T21:06:38.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64692024-12-13T21:06:38.275ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64702024-12-13T21:06:38.276ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "337b10d3-77d0-4844-807d-c5107011a885", "content-length": "134", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
64712024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64722024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
64732024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64742024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64752024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64762024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64772024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64782024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64792024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64802024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64812024-12-13T21:06:38.276ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
64822024-12-13T21:06:38.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64832024-12-13T21:06:38.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64842024-12-13T21:06:38.279ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64852024-12-13T21:06:38.279ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "404565b7-da5d-4915-827d-86b3aa6fb3dc", "content-length": "2", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
64862024-12-13T21:06:38.279ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64872024-12-13T21:06:38.279ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "54b014f9-c897-416b-949e-de7fd486b120", "content-length": "52", "date": "Fri, 13 Dec 2024 21:06:37 GMT"} })
64882024-12-13T21:06:38.279ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
64892024-12-13T21:06:38.279ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64902024-12-13T21:06:38.403ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "26984e66-e008-455b-8db5-1223691e706a", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} })
64912024-12-13T21:06:38.404ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
64922024-12-13T21:06:38.404ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64932024-12-13T21:06:38.404ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d42605e-73b8-423e-b340-fbd870c60ee7", "content-length": "682", "date": "Fri, 13 Dec 2024 21:06:38 GMT"} })
64942024-12-13T21:06:38.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64952024-12-13T21:06:38.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64962024-12-13T21:06:38.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64972024-12-13T21:06:38.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64982024-12-13T21:06:38.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64992024-12-13T21:06:38.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65002024-12-13T21:06:38.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65012024-12-13T21:06:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65022024-12-13T21:06:38.428ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 703.963009ms iteration = 19 status = {}
65032024-12-13T21:06:38.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 067d029a-a984-4adb-98e0-498688d63c36 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
65042024-12-13T21:06:38.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 067d029a-a984-4adb-98e0-498688d63c36 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
65052024-12-13T21:06:38.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 067d029a-a984-4adb-98e0-498688d63c36 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
65062024-12-13T21:06:39.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ce401852-4383-4935-8166-0e07cf114054 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65072024-12-13T21:06:39.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ce401852-4383-4935-8166-0e07cf114054 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65082024-12-13T21:06:39.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ce401852-4383-4935-8166-0e07cf114054 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65092024-12-13T21:06:40.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5fe37b8e-8234-47e6-9e86-9df3a671ca07 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65102024-12-13T21:06:40.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5fe37b8e-8234-47e6-9e86-9df3a671ca07 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65112024-12-13T21:06:40.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5fe37b8e-8234-47e6-9e86-9df3a671ca07 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65122024-12-13T21:06:41.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d2ed155f-98b9-4971-8ea2-bcf42d40ae3a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65132024-12-13T21:06:41.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d2ed155f-98b9-4971-8ea2-bcf42d40ae3a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65142024-12-13T21:06:41.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d2ed155f-98b9-4971-8ea2-bcf42d40ae3a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65152024-12-13T21:06:42.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8dae2232-bcd2-4a3d-b257-39bc9ec69bf1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65162024-12-13T21:06:42.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8dae2232-bcd2-4a3d-b257-39bc9ec69bf1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65172024-12-13T21:06:42.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8dae2232-bcd2-4a3d-b257-39bc9ec69bf1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65182024-12-13T21:06:43.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b1e75c6f-dcf6-48cc-8bfe-cd14bfeeeddc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65192024-12-13T21:06:43.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b1e75c6f-dcf6-48cc-8bfe-cd14bfeeeddc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65202024-12-13T21:06:43.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b1e75c6f-dcf6-48cc-8bfe-cd14bfeeeddc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65212024-12-13T21:06:44.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c19b69a-2302-46de-8b5f-b09a02d48176 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65222024-12-13T21:06:44.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c19b69a-2302-46de-8b5f-b09a02d48176 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65232024-12-13T21:06:44.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c19b69a-2302-46de-8b5f-b09a02d48176 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65242024-12-13T21:06:45.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = abab6abf-148d-4f4a-83fa-044fbd4bd071 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65252024-12-13T21:06:45.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = abab6abf-148d-4f4a-83fa-044fbd4bd071 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65262024-12-13T21:06:45.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = abab6abf-148d-4f4a-83fa-044fbd4bd071 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65272024-12-13T21:06:46.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9d0a42d-1c43-4743-8f28-42cf4f65b4a6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65282024-12-13T21:06:46.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9d0a42d-1c43-4743-8f28-42cf4f65b4a6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65292024-12-13T21:06:46.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9d0a42d-1c43-4743-8f28-42cf4f65b4a6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65302024-12-13T21:06:47.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71c8f66d-1938-4612-a6a5-f0a11a32aab3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65312024-12-13T21:06:47.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71c8f66d-1938-4612-a6a5-f0a11a32aab3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65322024-12-13T21:06:47.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71c8f66d-1938-4612-a6a5-f0a11a32aab3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65332024-12-13T21:06:47.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1259 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 254bbf23-706c-4509-9394-7067ec678b88 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
65342024-12-13T21:06:47.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
65352024-12-13T21:06:47.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
65362024-12-13T21:06:47.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65372024-12-13T21:06:47.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65382024-12-13T21:06:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65392024-12-13T21:06:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65402024-12-13T21:06:47.754ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65412024-12-13T21:06:47.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65422024-12-13T21:06:47.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65432024-12-13T21:06:47.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65442024-12-13T21:06:47.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65452024-12-13T21:06:47.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65462024-12-13T21:06:47.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65472024-12-13T21:06:47.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65482024-12-13T21:06:47.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65492024-12-13T21:06:47.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
65502024-12-13T21:06:47.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65512024-12-13T21:06:47.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65522024-12-13T21:06:47.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.993666ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65532024-12-13T21:06:47.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
65542024-12-13T21:06:47.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.945881ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
65552024-12-13T21:06:48.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5916aa0d-a8ea-46a1-96fb-cb9eabd14b9d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65562024-12-13T21:06:48.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5916aa0d-a8ea-46a1-96fb-cb9eabd14b9d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65572024-12-13T21:06:48.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5916aa0d-a8ea-46a1-96fb-cb9eabd14b9d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65582024-12-13T21:06:49.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83c52b1e-5e48-4eff-972c-ffa14b6d1b4a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65592024-12-13T21:06:49.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83c52b1e-5e48-4eff-972c-ffa14b6d1b4a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65602024-12-13T21:06:49.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 83c52b1e-5e48-4eff-972c-ffa14b6d1b4a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65612024-12-13T21:06:50.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bec1406d-8fff-432f-b250-ffd84c8b2334 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65622024-12-13T21:06:50.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bec1406d-8fff-432f-b250-ffd84c8b2334 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65632024-12-13T21:06:50.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bec1406d-8fff-432f-b250-ffd84c8b2334 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65642024-12-13T21:06:51.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82ce990e-38d1-4c06-a065-f946e2df5db3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65652024-12-13T21:06:51.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82ce990e-38d1-4c06-a065-f946e2df5db3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65662024-12-13T21:06:51.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82ce990e-38d1-4c06-a065-f946e2df5db3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65672024-12-13T21:06:52.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 342079f7-56c5-4087-bb37-67444a106c33 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65682024-12-13T21:06:52.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 342079f7-56c5-4087-bb37-67444a106c33 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65692024-12-13T21:06:52.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 342079f7-56c5-4087-bb37-67444a106c33 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65702024-12-13T21:06:53.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c0df43b6-2ed2-4794-9984-6be83fc5d607 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65712024-12-13T21:06:53.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c0df43b6-2ed2-4794-9984-6be83fc5d607 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65722024-12-13T21:06:53.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c0df43b6-2ed2-4794-9984-6be83fc5d607 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65732024-12-13T21:06:54.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c2b79d11-71f8-4b83-8349-e0a9e1ca3803 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65742024-12-13T21:06:54.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c2b79d11-71f8-4b83-8349-e0a9e1ca3803 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65752024-12-13T21:06:54.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c2b79d11-71f8-4b83-8349-e0a9e1ca3803 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65762024-12-13T21:06:55.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 16e09bc0-4f11-4934-98cc-924a28c859bc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65772024-12-13T21:06:55.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 16e09bc0-4f11-4934-98cc-924a28c859bc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65782024-12-13T21:06:55.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 16e09bc0-4f11-4934-98cc-924a28c859bc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65792024-12-13T21:06:56.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ac6d64c6-d532-4439-ba08-051c88f85509 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65802024-12-13T21:06:56.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ac6d64c6-d532-4439-ba08-051c88f85509 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65812024-12-13T21:06:56.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ac6d64c6-d532-4439-ba08-051c88f85509 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65822024-12-13T21:06:57.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6e7e4c3-9c17-465a-b5c7-3ca1221dbb1d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65832024-12-13T21:06:57.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6e7e4c3-9c17-465a-b5c7-3ca1221dbb1d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65842024-12-13T21:06:57.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6e7e4c3-9c17-465a-b5c7-3ca1221dbb1d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
65852024-12-13T21:06:57.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = b0ee8d37-2fe4-426e-9d1e-6a81298c846a response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
65862024-12-13T21:06:57.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
65872024-12-13T21:06:57.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65882024-12-13T21:06:57.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
65892024-12-13T21:06:57.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65902024-12-13T21:06:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65912024-12-13T21:06:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65922024-12-13T21:06:57.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65932024-12-13T21:06:57.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65942024-12-13T21:06:57.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65952024-12-13T21:06:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65962024-12-13T21:06:57.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65972024-12-13T21:06:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65982024-12-13T21:06:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65992024-12-13T21:06:57.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66002024-12-13T21:06:57.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66012024-12-13T21:06:57.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
66022024-12-13T21:06:57.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66032024-12-13T21:06:57.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66042024-12-13T21:06:57.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
66052024-12-13T21:06:57.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.171675ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
66062024-12-13T21:06:57.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.242314ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66072024-12-13T21:06:58.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6f9d6f0a-f6c0-4cb1-af2e-f7a2c5de1bfb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66082024-12-13T21:06:58.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6f9d6f0a-f6c0-4cb1-af2e-f7a2c5de1bfb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66092024-12-13T21:06:58.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6f9d6f0a-f6c0-4cb1-af2e-f7a2c5de1bfb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66102024-12-13T21:06:59.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3abf558e-9679-4088-8f10-f887601ea03d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66112024-12-13T21:06:59.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3abf558e-9679-4088-8f10-f887601ea03d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66122024-12-13T21:06:59.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3abf558e-9679-4088-8f10-f887601ea03d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66132024-12-13T21:07:00.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff9769e3-3f67-40ba-9486-0c750900e2a3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66142024-12-13T21:07:00.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff9769e3-3f67-40ba-9486-0c750900e2a3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66152024-12-13T21:07:00.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff9769e3-3f67-40ba-9486-0c750900e2a3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66162024-12-13T21:07:01.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8935f553-835a-441d-b56e-6ea88e732363 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66172024-12-13T21:07:01.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8935f553-835a-441d-b56e-6ea88e732363 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66182024-12-13T21:07:01.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8935f553-835a-441d-b56e-6ea88e732363 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66192024-12-13T21:07:02.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a9a1b53-2e8b-43e0-9d8f-52c0839b2c4f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66202024-12-13T21:07:02.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a9a1b53-2e8b-43e0-9d8f-52c0839b2c4f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66212024-12-13T21:07:02.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a9a1b53-2e8b-43e0-9d8f-52c0839b2c4f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66222024-12-13T21:07:02.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = f74b7abf-9cd5-4f2c-b303-5310be5fe978 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
66232024-12-13T21:07:02.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = f74b7abf-9cd5-4f2c-b303-5310be5fe978 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
66242024-12-13T21:07:02.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = f74b7abf-9cd5-4f2c-b303-5310be5fe978 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
66252024-12-13T21:07:02.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 11b3b8e6-d6a0-4c9b-91c2-853182cf666c roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
66262024-12-13T21:07:02.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 11b3b8e6-d6a0-4c9b-91c2-853182cf666c resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
66272024-12-13T21:07:02.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 11b3b8e6-d6a0-4c9b-91c2-853182cf666c response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
66282024-12-13T21:07:03.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6bf9ef05-effb-4957-8bf4-3df8f097f1c0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66292024-12-13T21:07:03.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6bf9ef05-effb-4957-8bf4-3df8f097f1c0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66302024-12-13T21:07:03.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6bf9ef05-effb-4957-8bf4-3df8f097f1c0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66312024-12-13T21:07:04.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 79f94111-09db-4d0f-8d05-1f61a3f95922 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66322024-12-13T21:07:04.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 79f94111-09db-4d0f-8d05-1f61a3f95922 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66332024-12-13T21:07:04.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 79f94111-09db-4d0f-8d05-1f61a3f95922 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66342024-12-13T21:07:05.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11032898-3a94-4803-955d-474ee4c2064c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66352024-12-13T21:07:05.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11032898-3a94-4803-955d-474ee4c2064c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66362024-12-13T21:07:05.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11032898-3a94-4803-955d-474ee4c2064c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66372024-12-13T21:07:06.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0830ed10-9552-4218-8721-2a7705e75199 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66382024-12-13T21:07:06.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0830ed10-9552-4218-8721-2a7705e75199 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66392024-12-13T21:07:06.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0830ed10-9552-4218-8721-2a7705e75199 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66402024-12-13T21:07:07.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1462 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d5ffbe31-2ff7-423c-b73b-3034faf679c3 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
66412024-12-13T21:07:07.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8e934e1c-573a-4252-b939-e7d743029bdf roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66422024-12-13T21:07:07.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8e934e1c-573a-4252-b939-e7d743029bdf resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66432024-12-13T21:07:07.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8e934e1c-573a-4252-b939-e7d743029bdf response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
66442024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
66452024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
66462024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
66472024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66482024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66492024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66502024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66512024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
66522024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
66532024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66542024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
66552024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
66562024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
66572024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66582024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66592024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66602024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
66612024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66622024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
66632024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66642024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
66652024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66662024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
66672024-12-13T21:07:07.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66682024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
66692024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66702024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66712024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66722024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66732024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66742024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66752024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66762024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66772024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66782024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66792024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66802024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66812024-12-13T21:07:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66822024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66832024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
66842024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
66852024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66862024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
66872024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66882024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66892024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
66902024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66912024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66922024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66932024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66942024-12-13T21:07:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66952024-12-13T21:07:07.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66962024-12-13T21:07:07.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66972024-12-13T21:07:07.726ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66982024-12-13T21:07:07.726ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66992024-12-13T21:07:07.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67002024-12-13T21:07:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67012024-12-13T21:07:07.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.708516ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67022024-12-13T21:07:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67032024-12-13T21:07:07.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67042024-12-13T21:07:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67052024-12-13T21:07:07.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1469, tv_nsec: 243082202 } })
67062024-12-13T21:07:07.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67072024-12-13T21:07:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67082024-12-13T21:07:07.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67092024-12-13T21:07:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67102024-12-13T21:07:07.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1469, tv_nsec: 245043503 } })
67112024-12-13T21:07:07.731ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67122024-12-13T21:07:07.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67132024-12-13T21:07:07.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67142024-12-13T21:07:07.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67152024-12-13T21:07:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67162024-12-13T21:07:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67172024-12-13T21:07:07.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67182024-12-13T21:07:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67192024-12-13T21:07:07.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67202024-12-13T21:07:07.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67212024-12-13T21:07:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67222024-12-13T21:07:07.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67232024-12-13T21:07:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67242024-12-13T21:07:07.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67252024-12-13T21:07:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67262024-12-13T21:07:07.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67272024-12-13T21:07:07.768ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67282024-12-13T21:07:07.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67292024-12-13T21:07:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67302024-12-13T21:07:07.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67312024-12-13T21:07:07.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67322024-12-13T21:07:07.779ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1469, tv_nsec: 293213562 } })
67332024-12-13T21:07:07.779ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
67342024-12-13T21:07:07.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352024-12-13T21:07:07.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67362024-12-13T21:07:07.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67372024-12-13T21:07:07.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67382024-12-13T21:07:07.780ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67392024-12-13T21:07:07.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.008382ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
67402024-12-13T21:07:07.780ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ddb16a2-8105-42f1-abe7-de49af7a63ca", "content-length": "26", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
67412024-12-13T21:07:07.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67422024-12-13T21:07:07.781ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67432024-12-13T21:07:07.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67442024-12-13T21:07:07.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67452024-12-13T21:07:07.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67462024-12-13T21:07:07.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67472024-12-13T21:07:07.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67482024-12-13T21:07:07.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67492024-12-13T21:07:07.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67502024-12-13T21:07:07.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67512024-12-13T21:07:07.784ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67522024-12-13T21:07:07.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67532024-12-13T21:07:07.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67542024-12-13T21:07:07.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67552024-12-13T21:07:07.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67562024-12-13T21:07:07.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67572024-12-13T21:07:07.786ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67582024-12-13T21:07:07.786ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67592024-12-13T21:07:07.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67602024-12-13T21:07:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67612024-12-13T21:07:07.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67622024-12-13T21:07:07.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67632024-12-13T21:07:07.788ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67642024-12-13T21:07:07.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67652024-12-13T21:07:07.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67662024-12-13T21:07:07.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.700889ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
67672024-12-13T21:07:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67682024-12-13T21:07:07.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67692024-12-13T21:07:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67702024-12-13T21:07:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
67712024-12-13T21:07:07.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67722024-12-13T21:07:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67732024-12-13T21:07:07.794ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67742024-12-13T21:07:07.794ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.912769ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67752024-12-13T21:07:07.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67762024-12-13T21:07:07.799ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67772024-12-13T21:07:07.800ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f33821f-ca18-42b1-a1bd-754b11994e9c", "content-length": "26", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
67782024-12-13T21:07:07.800ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67792024-12-13T21:07:07.801ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67802024-12-13T21:07:07.804ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
67812024-12-13T21:07:07.804ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.143955ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
67822024-12-13T21:07:07.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.239949ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67832024-12-13T21:07:07.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.681208ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67842024-12-13T21:07:07.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67852024-12-13T21:07:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
67862024-12-13T21:07:07.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67872024-12-13T21:07:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67882024-12-13T21:07:07.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.898271ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67892024-12-13T21:07:07.823ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.577459ms iteration = 20 status = 0
67902024-12-13T21:07:07.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.449719ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67912024-12-13T21:07:07.824ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67922024-12-13T21:07:07.824ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67932024-12-13T21:07:07.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.100672ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67942024-12-13T21:07:07.829ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.978439ms iteration = 23 status = {"physical_disks_added":0}
67952024-12-13T21:07:07.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67962024-12-13T21:07:07.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67972024-12-13T21:07:07.885ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67982024-12-13T21:07:07.886ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "85f63230-52ef-47b4-9318-5c32dc3ed204", "content-length": "1", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
67992024-12-13T21:07:07.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68002024-12-13T21:07:07.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68012024-12-13T21:07:07.890ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 166.836868ms iteration = 20 status = null
68022024-12-13T21:07:07.949ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68032024-12-13T21:07:07.949ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68042024-12-13T21:07:07.949ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb5c651-a734-47b4-a8a9-be115cb006b9", "content-length": "372", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68052024-12-13T21:07:07.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68062024-12-13T21:07:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68072024-12-13T21:07:07.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
68082024-12-13T21:07:07.951ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68092024-12-13T21:07:07.951ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e523e7cd-2ecc-44a7-a035-def361be355b", "content-length": "26", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68102024-12-13T21:07:07.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68112024-12-13T21:07:07.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
68122024-12-13T21:07:07.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68132024-12-13T21:07:07.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68142024-12-13T21:07:07.965ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 241.749241ms iteration = 20 status = {}
68152024-12-13T21:07:07.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68162024-12-13T21:07:07.993ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
68172024-12-13T21:07:07.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68182024-12-13T21:07:07.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d010798a-1df1-4be5-9a1b-6998cb62f785", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68192024-12-13T21:07:07.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68202024-12-13T21:07:07.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68212024-12-13T21:07:07.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68222024-12-13T21:07:07.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68232024-12-13T21:07:07.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68242024-12-13T21:07:07.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68252024-12-13T21:07:07.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68262024-12-13T21:07:07.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68272024-12-13T21:07:07.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68282024-12-13T21:07:07.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68292024-12-13T21:07:07.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68302024-12-13T21:07:07.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68312024-12-13T21:07:07.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68322024-12-13T21:07:08.001ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68332024-12-13T21:07:08.001ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68342024-12-13T21:07:08.001ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "14a433c8-5d9c-4f3c-80b8-32b4d4a5dc17", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68352024-12-13T21:07:08.004ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 281.03118ms iteration = 21 status = {}
68362024-12-13T21:07:08.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68372024-12-13T21:07:08.060ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "266255de-7e06-4b73-b2ec-30db6f0b3244", "content-length": "691", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68382024-12-13T21:07:08.060ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68392024-12-13T21:07:08.060ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68402024-12-13T21:07:08.060ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68412024-12-13T21:07:08.062ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.720756ms iteration = 20 status = {}
68422024-12-13T21:07:08.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68432024-12-13T21:07:08.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68442024-12-13T21:07:08.091ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
68452024-12-13T21:07:08.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68462024-12-13T21:07:08.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68472024-12-13T21:07:08.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68482024-12-13T21:07:08.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f2c8b7f-07a5-4e19-b6d2-463a993bd131", "content-length": "134", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68492024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68502024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
68512024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68522024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68532024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68542024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68552024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68562024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68572024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68582024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68592024-12-13T21:07:08.101ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
68602024-12-13T21:07:08.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68612024-12-13T21:07:08.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68622024-12-13T21:07:08.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68632024-12-13T21:07:08.104ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f44e1a6c-c935-44d0-80ff-74f655f1ca10", "content-length": "2", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68642024-12-13T21:07:08.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68652024-12-13T21:07:08.104ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dee9d6c6-b9a6-49da-93f0-d87476795803", "content-length": "52", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68662024-12-13T21:07:08.104ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
68672024-12-13T21:07:08.104ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68682024-12-13T21:07:08.203ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b48a6c89-0f8c-47c6-b9e7-f2116b3a18f8", "date": "Fri, 13 Dec 2024 21:07:07 GMT"} })
68692024-12-13T21:07:08.203ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
68702024-12-13T21:07:08.203ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68712024-12-13T21:07:08.203ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6bddd54-a16e-41d1-9a94-aa46f2ae6172", "content-length": "682", "date": "Fri, 13 Dec 2024 21:07:08 GMT"} })
68722024-12-13T21:07:08.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68732024-12-13T21:07:08.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68742024-12-13T21:07:08.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68752024-12-13T21:07:08.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68762024-12-13T21:07:08.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68772024-12-13T21:07:08.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68782024-12-13T21:07:08.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68792024-12-13T21:07:08.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68802024-12-13T21:07:08.219ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.617521ms iteration = 20 status = {}
68812024-12-13T21:07:08.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 86ebaa20-238e-4b9c-ad83-6bd21e24a382 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68822024-12-13T21:07:08.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 86ebaa20-238e-4b9c-ad83-6bd21e24a382 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68832024-12-13T21:07:08.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 86ebaa20-238e-4b9c-ad83-6bd21e24a382 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68842024-12-13T21:07:08.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 861895a5-cf87-4234-bf4c-d5d633b81a59 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68852024-12-13T21:07:08.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 861895a5-cf87-4234-bf4c-d5d633b81a59 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68862024-12-13T21:07:08.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 861895a5-cf87-4234-bf4c-d5d633b81a59 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68872024-12-13T21:07:09.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4df3ef1-034b-4cfb-be11-0f553369e514 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68882024-12-13T21:07:09.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4df3ef1-034b-4cfb-be11-0f553369e514 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68892024-12-13T21:07:09.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4df3ef1-034b-4cfb-be11-0f553369e514 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68902024-12-13T21:07:10.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77a22c45-ae69-4f66-afb3-135341dfc7a7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68912024-12-13T21:07:10.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77a22c45-ae69-4f66-afb3-135341dfc7a7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68922024-12-13T21:07:10.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77a22c45-ae69-4f66-afb3-135341dfc7a7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68932024-12-13T21:07:11.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f6011659-81b3-4b51-87a4-c29f47873d8a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68942024-12-13T21:07:11.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f6011659-81b3-4b51-87a4-c29f47873d8a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68952024-12-13T21:07:11.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f6011659-81b3-4b51-87a4-c29f47873d8a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68962024-12-13T21:07:12.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1a0e32da-0b8e-41a3-a8c0-cafd5412c5ef roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68972024-12-13T21:07:12.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1a0e32da-0b8e-41a3-a8c0-cafd5412c5ef resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68982024-12-13T21:07:12.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1a0e32da-0b8e-41a3-a8c0-cafd5412c5ef response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
68992024-12-13T21:07:13.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e22ec26a-232d-442b-83dc-727bd9e4a006 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69002024-12-13T21:07:13.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e22ec26a-232d-442b-83dc-727bd9e4a006 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69012024-12-13T21:07:13.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e22ec26a-232d-442b-83dc-727bd9e4a006 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69022024-12-13T21:07:14.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd19a69e-9258-40b9-85ff-37407880c982 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69032024-12-13T21:07:14.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd19a69e-9258-40b9-85ff-37407880c982 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69042024-12-13T21:07:14.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd19a69e-9258-40b9-85ff-37407880c982 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69052024-12-13T21:07:15.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 99b9ec02-57e2-49ff-858b-6d36384dde16 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69062024-12-13T21:07:15.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 99b9ec02-57e2-49ff-858b-6d36384dde16 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69072024-12-13T21:07:15.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 99b9ec02-57e2-49ff-858b-6d36384dde16 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69082024-12-13T21:07:16.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 321657fd-360e-4592-a8b7-ded0fb7c40ae roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69092024-12-13T21:07:16.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 321657fd-360e-4592-a8b7-ded0fb7c40ae resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69102024-12-13T21:07:16.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 321657fd-360e-4592-a8b7-ded0fb7c40ae response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69112024-12-13T21:07:17.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1209 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 951984c0-c324-4bbe-8ad9-43d65d97610d response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
69122024-12-13T21:07:17.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
69132024-12-13T21:07:17.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69142024-12-13T21:07:17.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
69152024-12-13T21:07:17.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69162024-12-13T21:07:17.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69172024-12-13T21:07:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69182024-12-13T21:07:17.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69192024-12-13T21:07:17.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69202024-12-13T21:07:17.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69212024-12-13T21:07:17.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.315192ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69222024-12-13T21:07:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69232024-12-13T21:07:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69242024-12-13T21:07:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69252024-12-13T21:07:17.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69262024-12-13T21:07:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69272024-12-13T21:07:17.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282024-12-13T21:07:17.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
69292024-12-13T21:07:17.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69302024-12-13T21:07:17.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69312024-12-13T21:07:17.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
69322024-12-13T21:07:17.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.821126ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
69332024-12-13T21:07:17.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd8c8f7e-14dd-4c62-af7b-51a8337a507a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69342024-12-13T21:07:17.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd8c8f7e-14dd-4c62-af7b-51a8337a507a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69352024-12-13T21:07:17.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd8c8f7e-14dd-4c62-af7b-51a8337a507a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69362024-12-13T21:07:18.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4ebe62a-3f58-465a-bcf6-b49d31b87a29 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69372024-12-13T21:07:18.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4ebe62a-3f58-465a-bcf6-b49d31b87a29 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69382024-12-13T21:07:18.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4ebe62a-3f58-465a-bcf6-b49d31b87a29 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69392024-12-13T21:07:19.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 049cd860-2f0d-454d-bd50-5e65e28854f5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69402024-12-13T21:07:19.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 049cd860-2f0d-454d-bd50-5e65e28854f5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69412024-12-13T21:07:19.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 049cd860-2f0d-454d-bd50-5e65e28854f5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69422024-12-13T21:07:20.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1446a5bc-a66d-409f-8b96-7b05ba6da735 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69432024-12-13T21:07:20.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1446a5bc-a66d-409f-8b96-7b05ba6da735 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69442024-12-13T21:07:20.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1446a5bc-a66d-409f-8b96-7b05ba6da735 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69452024-12-13T21:07:21.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8aee46a6-7374-4609-998c-74472c3e544c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69462024-12-13T21:07:21.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8aee46a6-7374-4609-998c-74472c3e544c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69472024-12-13T21:07:21.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8aee46a6-7374-4609-998c-74472c3e544c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69482024-12-13T21:07:22.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4f0d279-1eae-47f7-a382-6c7b6744bc5d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69492024-12-13T21:07:22.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4f0d279-1eae-47f7-a382-6c7b6744bc5d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69502024-12-13T21:07:22.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f4f0d279-1eae-47f7-a382-6c7b6744bc5d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69512024-12-13T21:07:24.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 21e4b725-d1e2-44bd-ac60-99ebd7247785 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69522024-12-13T21:07:24.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 21e4b725-d1e2-44bd-ac60-99ebd7247785 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69532024-12-13T21:07:24.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 21e4b725-d1e2-44bd-ac60-99ebd7247785 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69542024-12-13T21:07:25.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3cf6445e-4f4b-47bb-8a36-59ef98469f1f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69552024-12-13T21:07:25.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3cf6445e-4f4b-47bb-8a36-59ef98469f1f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69562024-12-13T21:07:25.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3cf6445e-4f4b-47bb-8a36-59ef98469f1f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69572024-12-13T21:07:26.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7fc4bd34-fa5b-4836-8b51-00da6f33c953 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69582024-12-13T21:07:26.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7fc4bd34-fa5b-4836-8b51-00da6f33c953 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69592024-12-13T21:07:26.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7fc4bd34-fa5b-4836-8b51-00da6f33c953 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69602024-12-13T21:07:27.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f427e05-979e-4c51-9d28-3f3baf8f3b82 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69612024-12-13T21:07:27.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f427e05-979e-4c51-9d28-3f3baf8f3b82 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69622024-12-13T21:07:27.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f427e05-979e-4c51-9d28-3f3baf8f3b82 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69632024-12-13T21:07:27.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 891551b2-b77c-4355-ac13-282841182232 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
69642024-12-13T21:07:27.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
69652024-12-13T21:07:27.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69662024-12-13T21:07:27.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
69672024-12-13T21:07:27.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69682024-12-13T21:07:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69692024-12-13T21:07:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69702024-12-13T21:07:27.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69712024-12-13T21:07:27.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69722024-12-13T21:07:27.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732024-12-13T21:07:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69742024-12-13T21:07:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69752024-12-13T21:07:27.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69762024-12-13T21:07:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69772024-12-13T21:07:27.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69782024-12-13T21:07:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69792024-12-13T21:07:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
69802024-12-13T21:07:27.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69812024-12-13T21:07:27.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69822024-12-13T21:07:27.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
69832024-12-13T21:07:27.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.286758ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
69842024-12-13T21:07:27.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.548933ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69852024-12-13T21:07:28.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 27f69b49-e1ce-40dd-bcca-19b6afa3d150 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69862024-12-13T21:07:28.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 27f69b49-e1ce-40dd-bcca-19b6afa3d150 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69872024-12-13T21:07:28.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 27f69b49-e1ce-40dd-bcca-19b6afa3d150 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69882024-12-13T21:07:29.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 571b61e2-3f1a-4824-8e6b-e200b46d2117 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69892024-12-13T21:07:29.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 571b61e2-3f1a-4824-8e6b-e200b46d2117 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69902024-12-13T21:07:29.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 571b61e2-3f1a-4824-8e6b-e200b46d2117 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69912024-12-13T21:07:30.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 506b5624-7077-4f8f-80d5-2813d3b43e4e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69922024-12-13T21:07:30.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 506b5624-7077-4f8f-80d5-2813d3b43e4e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69932024-12-13T21:07:30.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 506b5624-7077-4f8f-80d5-2813d3b43e4e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69942024-12-13T21:07:31.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7de346c-4ed9-4aa2-a3a2-6c205990a5ec roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69952024-12-13T21:07:31.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7de346c-4ed9-4aa2-a3a2-6c205990a5ec resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69962024-12-13T21:07:31.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b7de346c-4ed9-4aa2-a3a2-6c205990a5ec response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69972024-12-13T21:07:32.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 260105c1-ce9e-4da2-9d1e-ca312e97754e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69982024-12-13T21:07:32.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 260105c1-ce9e-4da2-9d1e-ca312e97754e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
69992024-12-13T21:07:32.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 260105c1-ce9e-4da2-9d1e-ca312e97754e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70002024-12-13T21:07:32.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = b5ab2470-f51a-42f4-b251-0918a6b68c03 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
70012024-12-13T21:07:32.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = b5ab2470-f51a-42f4-b251-0918a6b68c03 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
70022024-12-13T21:07:32.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = b5ab2470-f51a-42f4-b251-0918a6b68c03 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
70032024-12-13T21:07:32.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = d9f1b395-c44f-4664-a78f-4ad790eb4a32 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
70042024-12-13T21:07:32.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = d9f1b395-c44f-4664-a78f-4ad790eb4a32 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
70052024-12-13T21:07:32.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = d9f1b395-c44f-4664-a78f-4ad790eb4a32 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
70062024-12-13T21:07:33.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7fe34b2-ae70-47e6-bec4-e7f4ecc603e2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70072024-12-13T21:07:33.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7fe34b2-ae70-47e6-bec4-e7f4ecc603e2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70082024-12-13T21:07:33.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7fe34b2-ae70-47e6-bec4-e7f4ecc603e2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70092024-12-13T21:07:34.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3ad6600d-db47-461b-895e-4d47e73de515 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70102024-12-13T21:07:34.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3ad6600d-db47-461b-895e-4d47e73de515 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70112024-12-13T21:07:34.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3ad6600d-db47-461b-895e-4d47e73de515 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70122024-12-13T21:07:35.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a81e7a92-57d7-4a1a-8efc-76193981818d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70132024-12-13T21:07:35.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a81e7a92-57d7-4a1a-8efc-76193981818d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70142024-12-13T21:07:35.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a81e7a92-57d7-4a1a-8efc-76193981818d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70152024-12-13T21:07:35.649ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48343
70162024-12-13T21:07:35.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48343 req_id = 147b79bb-7a13-46cb-b68c-f755b4c91ea6 roles = RoleSet { roles: {} } uri = /metrics/producers
70172024-12-13T21:07:35.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48343 req_id = 147b79bb-7a13-46cb-b68c-f755b4c91ea6 resource = Database result = Ok(()) uri = /metrics/producers
70182024-12-13T21:07:35.688ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 9808715c-dad7-4981-b1eb-a6013e471643
70192024-12-13T21:07:35.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39322 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48343 req_id = 147b79bb-7a13-46cb-b68c-f755b4c91ea6 response_code = 201 uri = /metrics/producers
70202024-12-13T21:07:36.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22611904-7b2d-46b1-b8f0-1fba3bbc2ef4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70212024-12-13T21:07:36.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22611904-7b2d-46b1-b8f0-1fba3bbc2ef4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70222024-12-13T21:07:36.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22611904-7b2d-46b1-b8f0-1fba3bbc2ef4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70232024-12-13T21:07:37.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4391ada8-cd34-4d87-b76c-21f565f78ba9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70242024-12-13T21:07:37.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4391ada8-cd34-4d87-b76c-21f565f78ba9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70252024-12-13T21:07:37.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4391ada8-cd34-4d87-b76c-21f565f78ba9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
70262024-12-13T21:07:37.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1622 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 114bc8e7-22b0-4e4e-8b8e-f36eeb9bb47d response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
70272024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
70282024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
70292024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70302024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
70312024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
70322024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70332024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
70342024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70352024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70362024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
70372024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70382024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
70392024-12-13T21:07:37.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70402024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
70412024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70422024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
70432024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70442024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70452024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
70462024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70472024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
70482024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
70492024-12-13T21:07:37.723ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70502024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
70512024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70522024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70532024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
70542024-12-13T21:07:37.723ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
70552024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70562024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
70572024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70582024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
70592024-12-13T21:07:37.723ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:57:37.723724910 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70602024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70612024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
70622024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70632024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
70642024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70652024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
70662024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70672024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
70682024-12-13T21:07:37.723ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
70692024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.33\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
70702024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
70712024-12-13T21:07:37.723ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
70722024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
70732024-12-13T21:07:37.723ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
70742024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70752024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
70762024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70772024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
70782024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70792024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
70802024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
70812024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70822024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70832024-12-13T21:07:37.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
70842024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
70852024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
70862024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70872024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70882024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
70892024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70902024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70912024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
70922024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
70932024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70942024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70952024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
70962024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70972024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70982024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70992024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71002024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71012024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71022024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71032024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71042024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71052024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71062024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71072024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71082024-12-13T21:07:37.724ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
71092024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71102024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71112024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71122024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71132024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71142024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71152024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71162024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71172024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71182024-12-13T21:07:37.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 238830297 } })
71192024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71202024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71212024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71222024-12-13T21:07:37.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 238879448 } })
71232024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71242024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71252024-12-13T21:07:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71262024-12-13T21:07:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
71272024-12-13T21:07:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.53242ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
71282024-12-13T21:07:37.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
71292024-12-13T21:07:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.632373ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
71302024-12-13T21:07:37.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71312024-12-13T21:07:37.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71322024-12-13T21:07:37.726ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71332024-12-13T21:07:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71342024-12-13T21:07:37.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 241181767 } })
71352024-12-13T21:07:37.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.130351ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71362024-12-13T21:07:37.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71372024-12-13T21:07:37.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382024-12-13T21:07:37.728ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
71392024-12-13T21:07:37.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71402024-12-13T21:07:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71412024-12-13T21:07:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71422024-12-13T21:07:37.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71432024-12-13T21:07:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71442024-12-13T21:07:37.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71452024-12-13T21:07:37.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71462024-12-13T21:07:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71472024-12-13T21:07:37.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71482024-12-13T21:07:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71492024-12-13T21:07:37.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71502024-12-13T21:07:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71512024-12-13T21:07:37.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.141981ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
71522024-12-13T21:07:37.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71532024-12-13T21:07:37.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71542024-12-13T21:07:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71552024-12-13T21:07:37.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71562024-12-13T21:07:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71572024-12-13T21:07:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71582024-12-13T21:07:37.734ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71592024-12-13T21:07:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71602024-12-13T21:07:37.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71612024-12-13T21:07:37.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71622024-12-13T21:07:37.736ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:57:37.723724910 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71632024-12-13T21:07:37.736ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.994237ms iteration = 11 status = {"expiration":"2024-12-13T20:57:37.723724910Z","pruned":[]}
71642024-12-13T21:07:37.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71652024-12-13T21:07:37.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71662024-12-13T21:07:37.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71672024-12-13T21:07:37.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71682024-12-13T21:07:37.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71692024-12-13T21:07:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71702024-12-13T21:07:37.741ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 255636682 } })
71712024-12-13T21:07:37.741ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71722024-12-13T21:07:37.742ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.287645ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
71732024-12-13T21:07:37.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71742024-12-13T21:07:37.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71752024-12-13T21:07:37.744ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71762024-12-13T21:07:37.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71772024-12-13T21:07:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71782024-12-13T21:07:37.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71792024-12-13T21:07:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71802024-12-13T21:07:37.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71812024-12-13T21:07:37.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71822024-12-13T21:07:37.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71832024-12-13T21:07:37.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71842024-12-13T21:07:37.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71852024-12-13T21:07:37.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71862024-12-13T21:07:37.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71872024-12-13T21:07:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71882024-12-13T21:07:37.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71892024-12-13T21:07:37.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71902024-12-13T21:07:37.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71912024-12-13T21:07:37.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 35.176163ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71922024-12-13T21:07:37.759ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71932024-12-13T21:07:37.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71942024-12-13T21:07:37.760ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(635c6083-308c-44ce-a626-e6942dd71709, 0), (42902a7c-e2fa-4128-b5a2-e32c8d42dfb0, 0), (f0341a3b-ddc3-43b5-aaed-1d4972552f65, 0), (c4e46355-dcb7-42d9-aede-91c57b7078de, 0)] collection_id = 635c6083-308c-44ce-a626-e6942dd71709
71952024-12-13T21:07:37.760ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71962024-12-13T21:07:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71972024-12-13T21:07:37.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71982024-12-13T21:07:37.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71992024-12-13T21:07:37.763ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 277961152 } })
72002024-12-13T21:07:37.763ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
72012024-12-13T21:07:37.764ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72022024-12-13T21:07:37.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72032024-12-13T21:07:37.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72042024-12-13T21:07:37.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72052024-12-13T21:07:37.773ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
72062024-12-13T21:07:37.773ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b03baab9-4106-408c-a538-ca39255fd40f
72072024-12-13T21:07:37.773ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 3121db33-c939-4903-8b32-1da5a616f077
72082024-12-13T21:07:37.776ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 59c55c4e-0e07-4a9e-8dd1-a24630c68cb8
72092024-12-13T21:07:37.776ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 3121db33-c939-4903-8b32-1da5a616f077
72102024-12-13T21:07:37.776ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 59c55c4e-0e07-4a9e-8dd1-a24630c68cb8
72112024-12-13T21:07:37.776ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b03baab9-4106-408c-a538-ca39255fd40f
72122024-12-13T21:07:37.776ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 52.250925ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
72132024-12-13T21:07:37.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72142024-12-13T21:07:37.780ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72152024-12-13T21:07:37.780ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72162024-12-13T21:07:37.780ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.977807ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72172024-12-13T21:07:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72182024-12-13T21:07:37.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72192024-12-13T21:07:37.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72202024-12-13T21:07:37.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72212024-12-13T21:07:37.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72222024-12-13T21:07:37.786ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72232024-12-13T21:07:37.786ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72242024-12-13T21:07:37.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72252024-12-13T21:07:37.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72262024-12-13T21:07:37.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72272024-12-13T21:07:37.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.306174ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
72282024-12-13T21:07:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72292024-12-13T21:07:37.790ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72302024-12-13T21:07:37.790ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72312024-12-13T21:07:37.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72322024-12-13T21:07:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72332024-12-13T21:07:37.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.473826ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72342024-12-13T21:07:37.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72352024-12-13T21:07:37.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72362024-12-13T21:07:37.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72372024-12-13T21:07:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72382024-12-13T21:07:37.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
72392024-12-13T21:07:37.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72402024-12-13T21:07:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72412024-12-13T21:07:37.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72422024-12-13T21:07:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72432024-12-13T21:07:37.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72442024-12-13T21:07:37.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72452024-12-13T21:07:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72462024-12-13T21:07:37.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72472024-12-13T21:07:37.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72482024-12-13T21:07:37.801ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72492024-12-13T21:07:37.801ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72502024-12-13T21:07:37.801ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.098446ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72512024-12-13T21:07:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
72522024-12-13T21:07:37.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72532024-12-13T21:07:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72542024-12-13T21:07:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72552024-12-13T21:07:37.807ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.759403ms iteration = 21 status = 0
72562024-12-13T21:07:37.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72572024-12-13T21:07:37.811ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72582024-12-13T21:07:37.811ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.677634ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72592024-12-13T21:07:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72602024-12-13T21:07:37.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72612024-12-13T21:07:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72622024-12-13T21:07:37.813ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72632024-12-13T21:07:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72642024-12-13T21:07:37.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72652024-12-13T21:07:37.817ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 635c6083-308c-44ce-a626-e6942dd71709 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
72662024-12-13T21:07:37.817ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72672024-12-13T21:07:37.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72682024-12-13T21:07:37.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72692024-12-13T21:07:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72702024-12-13T21:07:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72712024-12-13T21:07:37.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
72722024-12-13T21:07:37.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.976901ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
72732024-12-13T21:07:37.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72742024-12-13T21:07:37.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.202936ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72752024-12-13T21:07:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72762024-12-13T21:07:37.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72772024-12-13T21:07:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72782024-12-13T21:07:37.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72792024-12-13T21:07:37.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72802024-12-13T21:07:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72812024-12-13T21:07:37.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72822024-12-13T21:07:37.831ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72832024-12-13T21:07:37.831ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72842024-12-13T21:07:37.831ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72852024-12-13T21:07:37.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72862024-12-13T21:07:37.832ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(42902a7c-e2fa-4128-b5a2-e32c8d42dfb0, 0), (f0341a3b-ddc3-43b5-aaed-1d4972552f65, 0), (c4e46355-dcb7-42d9-aede-91c57b7078de, 0)]
72872024-12-13T21:07:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72882024-12-13T21:07:37.832ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 346906430 } })
72892024-12-13T21:07:37.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.219043ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72902024-12-13T21:07:37.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72912024-12-13T21:07:37.834ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72922024-12-13T21:07:37.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72932024-12-13T21:07:37.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72942024-12-13T21:07:37.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72952024-12-13T21:07:37.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72962024-12-13T21:07:37.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72972024-12-13T21:07:37.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72982024-12-13T21:07:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
72992024-12-13T21:07:37.841ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73002024-12-13T21:07:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73012024-12-13T21:07:37.848ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73022024-12-13T21:07:37.848ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73032024-12-13T21:07:37.848ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73042024-12-13T21:07:37.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73052024-12-13T21:07:37.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73062024-12-13T21:07:37.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73072024-12-13T21:07:37.851ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73082024-12-13T21:07:37.851ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73092024-12-13T21:07:37.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.698932ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73102024-12-13T21:07:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73112024-12-13T21:07:37.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73122024-12-13T21:07:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73132024-12-13T21:07:37.870ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
73142024-12-13T21:07:37.870ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.243553ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73152024-12-13T21:07:37.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73162024-12-13T21:07:37.876ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73172024-12-13T21:07:37.876ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
73182024-12-13T21:07:37.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73192024-12-13T21:07:37.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73202024-12-13T21:07:37.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73212024-12-13T21:07:37.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73222024-12-13T21:07:37.878ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73232024-12-13T21:07:37.879ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "158bfb7b-3f06-418e-8bef-f4132c8d89b5", "content-length": "26", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
73242024-12-13T21:07:37.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73252024-12-13T21:07:37.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73262024-12-13T21:07:37.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73272024-12-13T21:07:37.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73282024-12-13T21:07:37.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73292024-12-13T21:07:37.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73302024-12-13T21:07:37.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73312024-12-13T21:07:37.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73322024-12-13T21:07:37.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73332024-12-13T21:07:37.886ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73342024-12-13T21:07:37.886ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73352024-12-13T21:07:37.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73362024-12-13T21:07:37.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73372024-12-13T21:07:37.939ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73382024-12-13T21:07:37.939ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73392024-12-13T21:07:37.939ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be69916a-ebb3-461b-ae9a-3695e3f135be", "content-length": "26", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
73402024-12-13T21:07:37.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73412024-12-13T21:07:37.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73422024-12-13T21:07:37.941ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
73432024-12-13T21:07:37.941ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73442024-12-13T21:07:37.942ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1425c8b3-5595-436b-b3fc-f9106369c3ab", "content-length": "26", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
73452024-12-13T21:07:37.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73462024-12-13T21:07:37.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
73472024-12-13T21:07:37.954ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73482024-12-13T21:07:37.954ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.970431ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73492024-12-13T21:07:37.964ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.614651ms iteration = 24 status = {"physical_disks_added":0}
73502024-12-13T21:07:37.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73512024-12-13T21:07:37.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73522024-12-13T21:07:38.034ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73532024-12-13T21:07:38.034ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73542024-12-13T21:07:38.035ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "199bd761-0f31-4ccf-94db-e71bc40f008a", "content-length": "372", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
73552024-12-13T21:07:38.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73562024-12-13T21:07:38.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73572024-12-13T21:07:38.036ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
73582024-12-13T21:07:38.036ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73592024-12-13T21:07:38.036ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
73602024-12-13T21:07:38.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 313.158033ms iteration = 12 status = {"generation":2}
73612024-12-13T21:07:38.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73622024-12-13T21:07:38.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73632024-12-13T21:07:38.037ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73642024-12-13T21:07:38.038ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "24260d83-328f-4b12-863f-8dcffaeee00a", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73652024-12-13T21:07:38.038ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73662024-12-13T21:07:38.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73672024-12-13T21:07:38.039ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d2f1428d-6fd1-4ea8-8bb1-3b2c810ad893", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73682024-12-13T21:07:38.039ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73692024-12-13T21:07:38.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73702024-12-13T21:07:38.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73712024-12-13T21:07:38.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73722024-12-13T21:07:38.041ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73732024-12-13T21:07:38.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 317.839454ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73742024-12-13T21:07:38.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73752024-12-13T21:07:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73762024-12-13T21:07:38.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73772024-12-13T21:07:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73782024-12-13T21:07:38.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73792024-12-13T21:07:38.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73802024-12-13T21:07:38.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73812024-12-13T21:07:38.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73822024-12-13T21:07:38.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73832024-12-13T21:07:38.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73842024-12-13T21:07:38.046ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73852024-12-13T21:07:38.046ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73862024-12-13T21:07:38.046ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
73872024-12-13T21:07:38.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 322.486765ms iteration = 12 status = {"generation":1}
73882024-12-13T21:07:38.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73892024-12-13T21:07:38.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73902024-12-13T21:07:38.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73912024-12-13T21:07:38.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73922024-12-13T21:07:38.051ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73932024-12-13T21:07:38.051ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73942024-12-13T21:07:38.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73952024-12-13T21:07:38.051ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e7e1ff15-8c84-4d64-a3c4-aa8850eda92c", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
73962024-12-13T21:07:38.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73972024-12-13T21:07:38.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73982024-12-13T21:07:38.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73992024-12-13T21:07:38.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74002024-12-13T21:07:38.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74012024-12-13T21:07:38.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74022024-12-13T21:07:38.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74032024-12-13T21:07:38.059ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 335.523503ms iteration = 21 status = {}
74042024-12-13T21:07:38.066ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
74052024-12-13T21:07:38.066ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
74062024-12-13T21:07:38.066ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
74072024-12-13T21:07:38.067ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "39d4f997-9625-4701-a734-526ccd3d5eb7", "content-length": "476", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74082024-12-13T21:07:38.067ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
74092024-12-13T21:07:38.067ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "590e7e43-8cec-46ad-8d38-9c94dc373834", "content-length": "734", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74102024-12-13T21:07:38.067ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
74112024-12-13T21:07:38.067ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "55386b6c-81ab-4b82-ad06-58eb23775713", "content-length": "111", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74122024-12-13T21:07:38.067ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
74132024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2874c42d-30fe-4c49-a6bd-24149f52a665", "content-length": "111", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74142024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
74152024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c2966f5-e6b8-42d7-8d42-1fdc1f30fba6", "content-length": "167", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74162024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
74172024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac978a0b-1fd4-4ebc-a520-45c3cddfb2ad", "content-length": "167", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74182024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
74192024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "57a30eef-34d0-41ec-ac17-be28cac38f98", "content-length": "175", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74202024-12-13T21:07:38.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
74212024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4b6bac1-0790-45f8-8988-b07d704aa2fa", "content-length": "175", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74222024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
74232024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c073783-a657-426b-bf51-6689d860d0fc", "content-length": "702", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74242024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
74252024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1850e265-7881-4add-8831-98a7378fa0f7", "content-length": "727", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74262024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
74272024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa622986-741c-47b6-977d-9bc5fca5823c", "content-length": "729", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74282024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
74292024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "867e766c-9843-4209-9cf7-d683a95e6055", "content-length": "728", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74302024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
74312024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c861345-1145-4e8a-aeb3-27e86ccc0d94", "content-length": "722", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74322024-12-13T21:07:38.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
74332024-12-13T21:07:38.070ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "153833b9-dba1-47e3-889c-e6840374f190", "content-length": "109", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74342024-12-13T21:07:38.070ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
74352024-12-13T21:07:38.070ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bee1def5-eec7-41bc-9d12-c39c4baf12ed", "content-length": "109", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74362024-12-13T21:07:38.070ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
74372024-12-13T21:07:38.070ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "75e35c9f-60da-481d-a1fc-a455d6578b36", "content-length": "169", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74382024-12-13T21:07:38.070ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
74392024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4da42da-8083-409b-b363-3ad9dba37158", "content-length": "169", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74402024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
74412024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "df846a01-f23b-439d-8a5b-26a76cb731c9", "content-length": "178", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74422024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
74432024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c382ae-9457-40b3-83c9-45ad69a63060", "content-length": "178", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74442024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
74452024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "55da2782-5bbe-4620-a69f-ee1eeab2ef9d", "content-length": "702", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74462024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
74472024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f084fc53-ca2d-4ac8-8c0a-2acdb0794fed", "content-length": "727", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74482024-12-13T21:07:38.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
74492024-12-13T21:07:38.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0278bb-1b08-4ac4-8b6c-b2e684dc2aa6", "content-length": "729", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74502024-12-13T21:07:38.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
74512024-12-13T21:07:38.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0b59e6-478b-465d-b69a-09f34c035478", "content-length": "728", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74522024-12-13T21:07:38.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74532024-12-13T21:07:38.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
74542024-12-13T21:07:38.092ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74552024-12-13T21:07:38.218ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74562024-12-13T21:07:38.219ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d1d6032e-f146-4c7f-a490-d1017ab8793a", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74572024-12-13T21:07:38.219ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74582024-12-13T21:07:38.220ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3c6c2c47-84d0-4c6f-9278-9a318e9e7087", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74592024-12-13T21:07:38.220ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74602024-12-13T21:07:38.222ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "25ed6f27-858f-4581-bac8-2eadbb669deb", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74612024-12-13T21:07:38.222ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74622024-12-13T21:07:38.224ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74632024-12-13T21:07:38.224ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 501.001375ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
74642024-12-13T21:07:38.270ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74652024-12-13T21:07:38.271ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "077dae84-37b0-4434-8d0a-a29b00763d42", "content-length": "1", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
74662024-12-13T21:07:38.272ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74672024-12-13T21:07:38.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74682024-12-13T21:07:38.304ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74692024-12-13T21:07:38.304ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2540a121-df5f-4468-aa8f-557e10f95379", "content-length": "691", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
74702024-12-13T21:07:38.304ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
74712024-12-13T21:07:38.304ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
74722024-12-13T21:07:38.304ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
74732024-12-13T21:07:38.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fc1a056b-f482-4fa7-91a9-7bd9374e5fb7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
74742024-12-13T21:07:38.305ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 582.19176ms iteration = 21 status = {}
74752024-12-13T21:07:38.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fc1a056b-f482-4fa7-91a9-7bd9374e5fb7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
74762024-12-13T21:07:38.306ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772024-12-13T21:07:38.307ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 583.457462ms iteration = 21 status = null
74782024-12-13T21:07:38.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fc1a056b-f482-4fa7-91a9-7bd9374e5fb7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
74792024-12-13T21:07:38.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74802024-12-13T21:07:38.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
74812024-12-13T21:07:38.308ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74822024-12-13T21:07:38.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74832024-12-13T21:07:38.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
74842024-12-13T21:07:38.314ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74852024-12-13T21:07:38.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
74862024-12-13T21:07:38.317ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74872024-12-13T21:07:38.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
74882024-12-13T21:07:38.318ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74892024-12-13T21:07:38.318ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74902024-12-13T21:07:38.319ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "141963ce-d22c-47d0-8d88-b8d61cf5c60d", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
74912024-12-13T21:07:38.320ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 596.86162ms iteration = 22 status = {}
74922024-12-13T21:07:38.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74932024-12-13T21:07:38.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74942024-12-13T21:07:38.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74952024-12-13T21:07:38.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74962024-12-13T21:07:38.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74972024-12-13T21:07:38.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74982024-12-13T21:07:38.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74992024-12-13T21:07:38.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75002024-12-13T21:07:38.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75012024-12-13T21:07:38.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75022024-12-13T21:07:38.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75032024-12-13T21:07:38.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75042024-12-13T21:07:38.377ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
75052024-12-13T21:07:38.377ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
75062024-12-13T21:07:38.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75072024-12-13T21:07:38.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75082024-12-13T21:07:38.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75092024-12-13T21:07:38.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75102024-12-13T21:07:38.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75112024-12-13T21:07:38.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75122024-12-13T21:07:38.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75132024-12-13T21:07:38.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75142024-12-13T21:07:38.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75152024-12-13T21:07:38.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75162024-12-13T21:07:38.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75172024-12-13T21:07:38.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
75182024-12-13T21:07:38.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75192024-12-13T21:07:38.389ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
75202024-12-13T21:07:38.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75212024-12-13T21:07:38.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75222024-12-13T21:07:38.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75232024-12-13T21:07:38.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75242024-12-13T21:07:38.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75252024-12-13T21:07:38.396ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75262024-12-13T21:07:38.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75272024-12-13T21:07:38.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75282024-12-13T21:07:38.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
75292024-12-13T21:07:38.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75302024-12-13T21:07:38.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75312024-12-13T21:07:38.404ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75322024-12-13T21:07:38.405ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0380617f-e8bc-4d76-b653-a85914644964", "content-length": "134", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
75332024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75342024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
75352024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75362024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75372024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75382024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75392024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75402024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75412024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75422024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75432024-12-13T21:07:38.405ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
75442024-12-13T21:07:38.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75452024-12-13T21:07:38.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75462024-12-13T21:07:38.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75472024-12-13T21:07:38.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75482024-12-13T21:07:38.407ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75492024-12-13T21:07:38.407ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "66698d1c-6c26-436e-b25f-73c8b5d184e4", "content-length": "2", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
75502024-12-13T21:07:38.407ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75512024-12-13T21:07:38.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75522024-12-13T21:07:38.408ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ce32c2c-5424-4007-89b9-97674b034035", "content-length": "52", "date": "Fri, 13 Dec 2024 21:07:37 GMT"} })
75532024-12-13T21:07:38.408ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
75542024-12-13T21:07:38.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75552024-12-13T21:07:38.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75562024-12-13T21:07:38.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75572024-12-13T21:07:38.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75582024-12-13T21:07:38.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75592024-12-13T21:07:38.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75602024-12-13T21:07:38.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75612024-12-13T21:07:38.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75622024-12-13T21:07:38.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75632024-12-13T21:07:38.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75642024-12-13T21:07:38.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75652024-12-13T21:07:38.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75662024-12-13T21:07:38.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75672024-12-13T21:07:38.421ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64825
75682024-12-13T21:07:38.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64825 req_id = 0cfaa37b-62b7-40a0-92bd-7782642723e6 roles = RoleSet { roles: {} } uri = /metrics/producers
75692024-12-13T21:07:38.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64825 req_id = 0cfaa37b-62b7-40a0-92bd-7782642723e6 resource = Database result = Ok(()) uri = /metrics/producers
75702024-12-13T21:07:38.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
75712024-12-13T21:07:38.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75722024-12-13T21:07:38.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75732024-12-13T21:07:38.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75742024-12-13T21:07:38.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75752024-12-13T21:07:38.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75762024-12-13T21:07:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75772024-12-13T21:07:38.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75782024-12-13T21:07:38.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
75792024-12-13T21:07:38.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75802024-12-13T21:07:38.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75812024-12-13T21:07:38.436ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0fcf3183-4482-4760-b10e-911ba8d847a4, kind: Service { id: 6e83647a-e5c1-40cc-a3f0-e80da403da03 }, name: Name("nexus-6e83647a-e5c1-40cc-a3f0-e80da403da03"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 11773aea-5e51-4630-a9e1-0fd47cc496d7, kind: Service { id: 0599e804-8800-4951-9d87-7a8a49a507a3 }, name: Name("nexus-0599e804-8800-4951-9d87-7a8a49a507a3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729f1ae5-19c6-4d46-aed9-eddb07ffd985, kind: Service { id: afa82dce-5a21-405b-9d0f-a4070132ff96 }, name: Name("nexus-afa82dce-5a21-405b-9d0f-a4070132ff96"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0911bf9a-fb79-4e5a-84d1-2af61004bd4d, kind: Service { id: 8fa769ab-44ab-4529-aca4-cf239281d788 }, name: Name("external-dns-8fa769ab-44ab-4529-aca4-cf239281d788"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a04b2ab8-04f1-43b7-88cb-9af608150cb1, kind: Service { id: d9f46008-cfe6-449f-ba60-44c3baf9576d }, name: Name("external-dns-d9f46008-cfe6-449f-ba60-44c3baf9576d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 56])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
75822024-12-13T21:07:38.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75832024-12-13T21:07:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75842024-12-13T21:07:38.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75852024-12-13T21:07:38.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
75862024-12-13T21:07:38.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75872024-12-13T21:07:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75882024-12-13T21:07:38.462ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 05a53e54-a11d-4f9d-b47d-dabf8673427d
75892024-12-13T21:07:38.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41104 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64825 req_id = 0cfaa37b-62b7-40a0-92bd-7782642723e6 response_code = 201 uri = /metrics/producers
75902024-12-13T21:07:38.488ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
75912024-12-13T21:07:38.488ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0911bf9a-fb79-4e5a-84d1-2af61004bd4d, kind: Service { id: 8fa769ab-44ab-4529-aca4-cf239281d788 }, name: Name("external-dns-8fa769ab-44ab-4529-aca4-cf239281d788"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a04b2ab8-04f1-43b7-88cb-9af608150cb1, kind: Service { id: d9f46008-cfe6-449f-ba60-44c3baf9576d }, name: Name("external-dns-d9f46008-cfe6-449f-ba60-44c3baf9576d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 56])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0fcf3183-4482-4760-b10e-911ba8d847a4, kind: Service { id: 6e83647a-e5c1-40cc-a3f0-e80da403da03 }, name: Name("nexus-6e83647a-e5c1-40cc-a3f0-e80da403da03"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 11773aea-5e51-4630-a9e1-0fd47cc496d7, kind: Service { id: 0599e804-8800-4951-9d87-7a8a49a507a3 }, name: Name("nexus-0599e804-8800-4951-9d87-7a8a49a507a3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 729f1ae5-19c6-4d46-aed9-eddb07ffd985, kind: Service { id: afa82dce-5a21-405b-9d0f-a4070132ff96 }, name: Name("nexus-afa82dce-5a21-405b-9d0f-a4070132ff96"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
75922024-12-13T21:07:38.488ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
75932024-12-13T21:07:38.528ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08bb5aee-1561-4ecd-88b6-de064adda57b", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
75942024-12-13T21:07:38.528ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
75952024-12-13T21:07:38.528ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75962024-12-13T21:07:38.532ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f53e214-d62f-4e55-9125-f1b0a1ff0379", "content-length": "682", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
75972024-12-13T21:07:38.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75982024-12-13T21:07:38.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75992024-12-13T21:07:38.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76002024-12-13T21:07:38.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76012024-12-13T21:07:38.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76022024-12-13T21:07:38.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76032024-12-13T21:07:38.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76042024-12-13T21:07:38.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76052024-12-13T21:07:38.550ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 826.206209ms iteration = 21 status = {}
76062024-12-13T21:07:38.603ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 82024834-9725-4304-9edd-af6b519041b3, time_created: 2024-12-13T20:58:05.394560Z, time_modified: 2024-12-13T20:58:05.394560Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
76072024-12-13T21:07:38.603ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
76082024-12-13T21:07:38.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76092024-12-13T21:07:38.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76102024-12-13T21:07:38.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76112024-12-13T21:07:38.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76122024-12-13T21:07:38.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132024-12-13T21:07:38.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
76142024-12-13T21:07:38.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 8c675141-f825-4857-a46a-979c1b55fe8e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
76152024-12-13T21:07:38.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 8c675141-f825-4857-a46a-979c1b55fe8e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
76162024-12-13T21:07:38.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 8c675141-f825-4857-a46a-979c1b55fe8e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
76172024-12-13T21:07:38.641ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
76182024-12-13T21:07:38.648ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "cd375f39-a409-4782-80ee-e6ff77e7072d", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
76192024-12-13T21:07:38.650ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
76202024-12-13T21:07:38.650ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 927.055096ms
76212024-12-13T21:07:38.650ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 927.063046ms iteration = 3 status = {}
76222024-12-13T21:07:38.706ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "31903424-4d5f-4286-a3ab-00a5deedbb4b", "content-length": "30426", "date": "Fri, 13 Dec 2024 21:07:38 GMT"} })
76232024-12-13T21:07:38.708ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
76242024-12-13T21:07:38.708ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
76252024-12-13T21:07:38.708ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
76262024-12-13T21:07:38.710ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76272024-12-13T21:07:38.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76282024-12-13T21:07:38.712ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76292024-12-13T21:07:38.714ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
76302024-12-13T21:07:38.714ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76312024-12-13T21:07:38.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76322024-12-13T21:07:38.893ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 89845899-782f-4acd-a441-982394b850f2 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
76332024-12-13T21:07:38.894ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 89845899-782f-4acd-a441-982394b850f2 time_started = 2024-12-13 21:07:38.066593 UTC
76342024-12-13T21:07:38.894ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.170462529s iteration = 4 status = {"collection_id":"89845899-782f-4acd-a441-982394b850f2","time_done":"2024-12-13 21:07:38.708743 UTC","time_started":"2024-12-13 21:07:38.066593 UTC"}
76352024-12-13T21:07:38.894ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
76362024-12-13T21:07:38.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76372024-12-13T21:07:38.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76382024-12-13T21:07:38.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76392024-12-13T21:07:38.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76402024-12-13T21:07:38.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76412024-12-13T21:07:38.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76422024-12-13T21:07:38.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76432024-12-13T21:07:38.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76442024-12-13T21:07:38.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76452024-12-13T21:07:38.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76462024-12-13T21:07:38.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76472024-12-13T21:07:38.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76482024-12-13T21:07:38.941ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 47.552484ms iteration = 25 status = {"physical_disks_added":0}
76492024-12-13T21:07:39.240ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33880
76502024-12-13T21:07:39.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33880 req_id = d15d42be-dc6c-412d-be65-b6325181b700 roles = RoleSet { roles: {} } uri = /metrics/producers
76512024-12-13T21:07:39.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33880 req_id = d15d42be-dc6c-412d-be65-b6325181b700 resource = Database result = Ok(()) uri = /metrics/producers
76522024-12-13T21:07:39.253ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 82024834-9725-4304-9edd-af6b519041b3
76532024-12-13T21:07:39.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12569 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33880 req_id = d15d42be-dc6c-412d-be65-b6325181b700 response_code = 201 uri = /metrics/producers
76542024-12-13T21:07:39.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5f5e9410-5075-4dca-b56d-f9f4e78d293f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76552024-12-13T21:07:39.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5f5e9410-5075-4dca-b56d-f9f4e78d293f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76562024-12-13T21:07:39.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5f5e9410-5075-4dca-b56d-f9f4e78d293f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76572024-12-13T21:07:39.470ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40941
76582024-12-13T21:07:39.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40941 req_id = 702165b8-c991-4950-bd56-ac1fccfe4e04 roles = RoleSet { roles: {} } uri = /metrics/producers
76592024-12-13T21:07:39.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40941 req_id = 702165b8-c991-4950-bd56-ac1fccfe4e04 resource = Database result = Ok(()) uri = /metrics/producers
76602024-12-13T21:07:39.514ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 24d23071-4a22-4662-832b-fb2493a9b66b
76612024-12-13T21:07:39.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43459 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40941 req_id = 702165b8-c991-4950-bd56-ac1fccfe4e04 response_code = 201 uri = /metrics/producers
76622024-12-13T21:07:40.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 54b4afc3-9480-4398-92c4-e3d67f94f50b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76632024-12-13T21:07:40.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 54b4afc3-9480-4398-92c4-e3d67f94f50b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76642024-12-13T21:07:40.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 54b4afc3-9480-4398-92c4-e3d67f94f50b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76652024-12-13T21:07:41.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c9d86318-7fd3-48aa-a0fb-3f0e6920ed68 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76662024-12-13T21:07:41.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c9d86318-7fd3-48aa-a0fb-3f0e6920ed68 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76672024-12-13T21:07:41.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c9d86318-7fd3-48aa-a0fb-3f0e6920ed68 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76682024-12-13T21:07:42.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 80b559ea-a3e7-406b-99f3-05cc18eb1de6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76692024-12-13T21:07:42.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 80b559ea-a3e7-406b-99f3-05cc18eb1de6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76702024-12-13T21:07:42.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 80b559ea-a3e7-406b-99f3-05cc18eb1de6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76712024-12-13T21:07:43.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb8f2006-f88c-442d-9cb6-7b5063d07ba7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76722024-12-13T21:07:43.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb8f2006-f88c-442d-9cb6-7b5063d07ba7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76732024-12-13T21:07:43.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb8f2006-f88c-442d-9cb6-7b5063d07ba7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76742024-12-13T21:07:43.997ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53796
76752024-12-13T21:07:43.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53796 req_id = 72233a57-bf1b-46fb-afa2-fdd4a04c0fc5 roles = RoleSet { roles: {} } uri = /metrics/producers
76762024-12-13T21:07:43.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53796 req_id = 72233a57-bf1b-46fb-afa2-fdd4a04c0fc5 resource = Database result = Ok(()) uri = /metrics/producers
76772024-12-13T21:07:44.006ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 3f777322-11c9-4c30-9537-a1cc3a15fe00
76782024-12-13T21:07:44.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9654 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53796 req_id = 72233a57-bf1b-46fb-afa2-fdd4a04c0fc5 response_code = 201 uri = /metrics/producers
76792024-12-13T21:07:44.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eda7d78a-8d02-4100-a549-0d33c18f7df0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76802024-12-13T21:07:44.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eda7d78a-8d02-4100-a549-0d33c18f7df0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76812024-12-13T21:07:44.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eda7d78a-8d02-4100-a549-0d33c18f7df0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76822024-12-13T21:07:45.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e18230c8-fe2c-4ea0-9b62-89d3ef897f70 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76832024-12-13T21:07:45.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e18230c8-fe2c-4ea0-9b62-89d3ef897f70 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76842024-12-13T21:07:45.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e18230c8-fe2c-4ea0-9b62-89d3ef897f70 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76852024-12-13T21:07:46.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aba4aa26-1d6a-46ef-b706-8886fd18e042 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76862024-12-13T21:07:46.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aba4aa26-1d6a-46ef-b706-8886fd18e042 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76872024-12-13T21:07:46.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aba4aa26-1d6a-46ef-b706-8886fd18e042 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76882024-12-13T21:07:47.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a55c5cca-93c4-4a09-9648-d1d1e5441da8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76892024-12-13T21:07:47.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a55c5cca-93c4-4a09-9648-d1d1e5441da8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76902024-12-13T21:07:47.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a55c5cca-93c4-4a09-9648-d1d1e5441da8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
76912024-12-13T21:07:47.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 66491d08-572b-4f10-b84e-6dd23b608467 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
76922024-12-13T21:07:47.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 66491d08-572b-4f10-b84e-6dd23b608467 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
76932024-12-13T21:07:47.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 66491d08-572b-4f10-b84e-6dd23b608467 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
76942024-12-13T21:07:47.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = ba0a2a8d-9fba-4e9c-85f8-8e9a9ee0c34a roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
76952024-12-13T21:07:47.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = ba0a2a8d-9fba-4e9c-85f8-8e9a9ee0c34a resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
76962024-12-13T21:07:47.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = ba0a2a8d-9fba-4e9c-85f8-8e9a9ee0c34a response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
76972024-12-13T21:07:47.665ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ba1e573b-6cde-429b-8a68-874086a1a3fc response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
76982024-12-13T21:07:47.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
76992024-12-13T21:07:47.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77002024-12-13T21:07:47.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
77012024-12-13T21:07:47.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77022024-12-13T21:07:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77032024-12-13T21:07:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77042024-12-13T21:07:47.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77052024-12-13T21:07:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77062024-12-13T21:07:47.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-12-13T21:07:47.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.588993ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77082024-12-13T21:07:47.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77092024-12-13T21:07:47.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77102024-12-13T21:07:47.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77112024-12-13T21:07:47.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77122024-12-13T21:07:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77132024-12-13T21:07:47.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77142024-12-13T21:07:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
77152024-12-13T21:07:47.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77162024-12-13T21:07:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77172024-12-13T21:07:47.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
77182024-12-13T21:07:47.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.504046ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
77192024-12-13T21:07:48.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e482d19-4a1d-494a-8c8e-695854c29b94 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77202024-12-13T21:07:48.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e482d19-4a1d-494a-8c8e-695854c29b94 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77212024-12-13T21:07:48.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e482d19-4a1d-494a-8c8e-695854c29b94 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77222024-12-13T21:07:49.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26d20557-79b2-4961-9cd3-2822e663a981 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77232024-12-13T21:07:49.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26d20557-79b2-4961-9cd3-2822e663a981 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77242024-12-13T21:07:49.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 26d20557-79b2-4961-9cd3-2822e663a981 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77252024-12-13T21:07:50.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22c8e0fa-53d1-4c18-96b7-c4adaddbbd29 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77262024-12-13T21:07:50.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22c8e0fa-53d1-4c18-96b7-c4adaddbbd29 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77272024-12-13T21:07:50.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 22c8e0fa-53d1-4c18-96b7-c4adaddbbd29 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77282024-12-13T21:07:51.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad3aae89-c2c4-4c5e-83b6-30d12ad3e803 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77292024-12-13T21:07:51.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad3aae89-c2c4-4c5e-83b6-30d12ad3e803 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77302024-12-13T21:07:51.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ad3aae89-c2c4-4c5e-83b6-30d12ad3e803 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77312024-12-13T21:07:52.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0b10d99c-576d-43d6-9879-c6da36c56c12 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77322024-12-13T21:07:52.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0b10d99c-576d-43d6-9879-c6da36c56c12 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77332024-12-13T21:07:52.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0b10d99c-576d-43d6-9879-c6da36c56c12 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77342024-12-13T21:07:53.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9ce8ad21-7025-4f40-9aa2-96970b095d85 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77352024-12-13T21:07:53.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9ce8ad21-7025-4f40-9aa2-96970b095d85 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77362024-12-13T21:07:53.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9ce8ad21-7025-4f40-9aa2-96970b095d85 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77372024-12-13T21:07:54.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 477531d2-ea3e-4163-8869-256a2d96d7c4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77382024-12-13T21:07:54.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 477531d2-ea3e-4163-8869-256a2d96d7c4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77392024-12-13T21:07:54.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 477531d2-ea3e-4163-8869-256a2d96d7c4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77402024-12-13T21:07:55.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2073a83e-0233-4bf9-8f74-0090fab61db3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77412024-12-13T21:07:55.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2073a83e-0233-4bf9-8f74-0090fab61db3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77422024-12-13T21:07:55.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2073a83e-0233-4bf9-8f74-0090fab61db3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77432024-12-13T21:07:56.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a31489fb-9711-441c-9bd0-e7143da4e6b7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77442024-12-13T21:07:56.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a31489fb-9711-441c-9bd0-e7143da4e6b7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77452024-12-13T21:07:56.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a31489fb-9711-441c-9bd0-e7143da4e6b7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77462024-12-13T21:07:56.985ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:37786
77472024-12-13T21:07:56.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37786 req_id = bdd1ddf9-0e23-4c0c-a8d5-18b95d05b7c7 roles = RoleSet { roles: {} } uri = /metrics/producers
77482024-12-13T21:07:56.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37786 req_id = bdd1ddf9-0e23-4c0c-a8d5-18b95d05b7c7 resource = Database result = Ok(()) uri = /metrics/producers
77492024-12-13T21:07:57.018ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 80dcafa7-ddfc-4f6b-a596-bd2a7d203daf
77502024-12-13T21:07:57.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33527 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37786 req_id = bdd1ddf9-0e23-4c0c-a8d5-18b95d05b7c7 response_code = 201 uri = /metrics/producers
77512024-12-13T21:07:57.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1231 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = cca138fc-b2c8-4dc6-8d93-e08f956c52eb response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
77522024-12-13T21:07:57.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
77532024-12-13T21:07:57.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77542024-12-13T21:07:57.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
77552024-12-13T21:07:57.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77562024-12-13T21:07:57.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77572024-12-13T21:07:57.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77582024-12-13T21:07:57.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77592024-12-13T21:07:57.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77602024-12-13T21:07:57.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77612024-12-13T21:07:57.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77622024-12-13T21:07:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77632024-12-13T21:07:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77642024-12-13T21:07:57.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77652024-12-13T21:07:57.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77662024-12-13T21:07:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77672024-12-13T21:07:57.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
77682024-12-13T21:07:57.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77692024-12-13T21:07:57.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77702024-12-13T21:07:57.743ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
77712024-12-13T21:07:57.743ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.995918ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
77722024-12-13T21:07:57.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.303132ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77732024-12-13T21:07:57.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d735eacd-8fd8-4d11-8fbc-cc6fa21917e9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77742024-12-13T21:07:57.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d735eacd-8fd8-4d11-8fbc-cc6fa21917e9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77752024-12-13T21:07:57.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d735eacd-8fd8-4d11-8fbc-cc6fa21917e9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77762024-12-13T21:07:58.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e86c54f-e4e0-470d-9d14-9cef38b9a3f7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77772024-12-13T21:07:58.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e86c54f-e4e0-470d-9d14-9cef38b9a3f7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77782024-12-13T21:07:58.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e86c54f-e4e0-470d-9d14-9cef38b9a3f7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77792024-12-13T21:07:59.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 521018bc-d1ed-4cff-a239-25cc05676394 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77802024-12-13T21:07:59.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 521018bc-d1ed-4cff-a239-25cc05676394 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77812024-12-13T21:07:59.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 521018bc-d1ed-4cff-a239-25cc05676394 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77822024-12-13T21:08:00.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bc9e6976-555b-4bbe-8726-be28e80370db roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77832024-12-13T21:08:00.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bc9e6976-555b-4bbe-8726-be28e80370db resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77842024-12-13T21:08:00.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bc9e6976-555b-4bbe-8726-be28e80370db response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77852024-12-13T21:08:01.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 986ff055-83e0-4ca4-88ef-49ac3dfb7090 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77862024-12-13T21:08:01.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 986ff055-83e0-4ca4-88ef-49ac3dfb7090 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77872024-12-13T21:08:01.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 986ff055-83e0-4ca4-88ef-49ac3dfb7090 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77882024-12-13T21:08:02.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 95636dda-9ed3-4c5c-8b1e-458a5948be71 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
77892024-12-13T21:08:02.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 95636dda-9ed3-4c5c-8b1e-458a5948be71 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
77902024-12-13T21:08:02.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 95636dda-9ed3-4c5c-8b1e-458a5948be71 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
77912024-12-13T21:08:02.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 06009509-1607-4fdf-b0b6-60d58cd0b91b roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
77922024-12-13T21:08:02.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 06009509-1607-4fdf-b0b6-60d58cd0b91b resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
77932024-12-13T21:08:02.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 06009509-1607-4fdf-b0b6-60d58cd0b91b response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
77942024-12-13T21:08:02.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1777ffcb-ed3d-4ea8-bd79-67592f207dad roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77952024-12-13T21:08:02.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1777ffcb-ed3d-4ea8-bd79-67592f207dad resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77962024-12-13T21:08:02.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1777ffcb-ed3d-4ea8-bd79-67592f207dad response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77972024-12-13T21:08:03.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 38c639ed-388e-4553-98ef-d47d9ff7b249 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77982024-12-13T21:08:03.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 38c639ed-388e-4553-98ef-d47d9ff7b249 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
77992024-12-13T21:08:03.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 38c639ed-388e-4553-98ef-d47d9ff7b249 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78002024-12-13T21:08:04.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 89050f35-94f6-4be4-a21f-e83b79c82853 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78012024-12-13T21:08:04.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 89050f35-94f6-4be4-a21f-e83b79c82853 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78022024-12-13T21:08:04.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 89050f35-94f6-4be4-a21f-e83b79c82853 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78032024-12-13T21:08:05.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11d7ec3b-f704-45cd-94ca-b89164b32ef8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78042024-12-13T21:08:05.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11d7ec3b-f704-45cd-94ca-b89164b32ef8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78052024-12-13T21:08:05.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 11d7ec3b-f704-45cd-94ca-b89164b32ef8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78062024-12-13T21:08:06.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9b37c1f-e3cc-48fa-a28c-6f9d2a26e890 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78072024-12-13T21:08:06.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9b37c1f-e3cc-48fa-a28c-6f9d2a26e890 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78082024-12-13T21:08:06.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e9b37c1f-e3cc-48fa-a28c-6f9d2a26e890 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
78092024-12-13T21:08:07.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 43a94c30-fc30-4066-bf88-aaf4f38a455a response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
78102024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
78112024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78122024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
78132024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
78142024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78152024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
78162024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78172024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78182024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
78192024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78202024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
78212024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78222024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78232024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
78242024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
78252024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78262024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78272024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
78282024-12-13T21:08:07.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78292024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
78302024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78312024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78322024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
78332024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78342024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
78352024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
78362024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78372024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
78382024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
78392024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78402024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78412024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
78422024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78432024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
78442024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78452024-12-13T21:08:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78462024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78472024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78482024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78492024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78502024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78512024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78522024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78532024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78542024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78552024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78562024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78572024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78582024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78592024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78602024-12-13T21:08:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78612024-12-13T21:08:07.725ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.869119ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78622024-12-13T21:08:07.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78632024-12-13T21:08:07.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642024-12-13T21:08:07.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652024-12-13T21:08:07.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78662024-12-13T21:08:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78672024-12-13T21:08:07.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78682024-12-13T21:08:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78692024-12-13T21:08:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78702024-12-13T21:08:07.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78712024-12-13T21:08:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78722024-12-13T21:08:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78732024-12-13T21:08:07.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78742024-12-13T21:08:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78752024-12-13T21:08:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78762024-12-13T21:08:07.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78772024-12-13T21:08:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78782024-12-13T21:08:07.731ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78792024-12-13T21:08:07.731ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78802024-12-13T21:08:07.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78812024-12-13T21:08:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78822024-12-13T21:08:07.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78832024-12-13T21:08:07.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78842024-12-13T21:08:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78852024-12-13T21:08:07.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1529, tv_nsec: 247247728 } })
78862024-12-13T21:08:07.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1529, tv_nsec: 247347991 } })
78872024-12-13T21:08:07.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
78882024-12-13T21:08:07.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78892024-12-13T21:08:07.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78902024-12-13T21:08:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78912024-12-13T21:08:07.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78922024-12-13T21:08:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78932024-12-13T21:08:07.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78942024-12-13T21:08:07.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78952024-12-13T21:08:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78962024-12-13T21:08:07.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.148981ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
78972024-12-13T21:08:07.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78982024-12-13T21:08:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78992024-12-13T21:08:07.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79002024-12-13T21:08:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79012024-12-13T21:08:07.738ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1529, tv_nsec: 253162631 } })
79022024-12-13T21:08:07.738ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
79032024-12-13T21:08:07.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79042024-12-13T21:08:07.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79052024-12-13T21:08:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79062024-12-13T21:08:07.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79072024-12-13T21:08:07.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79082024-12-13T21:08:07.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79092024-12-13T21:08:07.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79102024-12-13T21:08:07.743ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79112024-12-13T21:08:07.743ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.819144ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79122024-12-13T21:08:07.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
79132024-12-13T21:08:07.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79142024-12-13T21:08:07.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79152024-12-13T21:08:07.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79162024-12-13T21:08:07.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79172024-12-13T21:08:07.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79182024-12-13T21:08:07.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79192024-12-13T21:08:07.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
79202024-12-13T21:08:07.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.332639ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
79212024-12-13T21:08:07.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.17366ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
79222024-12-13T21:08:07.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79232024-12-13T21:08:07.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79242024-12-13T21:08:07.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79252024-12-13T21:08:07.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79262024-12-13T21:08:07.770ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79272024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79282024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79292024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79302024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79312024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79322024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79332024-12-13T21:08:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79342024-12-13T21:08:07.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79352024-12-13T21:08:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79362024-12-13T21:08:07.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.247932ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
79372024-12-13T21:08:07.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.036002ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79382024-12-13T21:08:07.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79392024-12-13T21:08:07.773ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79402024-12-13T21:08:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79412024-12-13T21:08:07.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.902006ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79422024-12-13T21:08:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
79432024-12-13T21:08:07.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79442024-12-13T21:08:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79452024-12-13T21:08:07.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79462024-12-13T21:08:07.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79472024-12-13T21:08:07.777ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.420381ms iteration = 22 status = 0
79482024-12-13T21:08:07.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79492024-12-13T21:08:07.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79502024-12-13T21:08:07.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79512024-12-13T21:08:07.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79522024-12-13T21:08:07.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79532024-12-13T21:08:07.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79542024-12-13T21:08:07.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79552024-12-13T21:08:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79562024-12-13T21:08:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79572024-12-13T21:08:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79582024-12-13T21:08:07.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.171977ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79592024-12-13T21:08:07.808ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79602024-12-13T21:08:07.808ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79612024-12-13T21:08:07.808ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.903303ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79622024-12-13T21:08:07.847ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.429628ms iteration = 26 status = {"physical_disks_added":0}
79632024-12-13T21:08:07.947ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79642024-12-13T21:08:07.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed82659f-048b-417b-9966-8d2e3e1b83e3", "content-length": "691", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
79652024-12-13T21:08:07.948ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
79662024-12-13T21:08:07.948ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
79672024-12-13T21:08:07.948ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79682024-12-13T21:08:07.950ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 227.480371ms iteration = 22 status = {}
79692024-12-13T21:08:07.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79702024-12-13T21:08:07.966ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79712024-12-13T21:08:07.966ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae8df54e-0e9a-48ae-a935-ea7a2e50a611", "content-length": "26", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
79722024-12-13T21:08:07.966ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79732024-12-13T21:08:07.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79742024-12-13T21:08:07.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79752024-12-13T21:08:07.978ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79762024-12-13T21:08:07.978ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75b81865-c6d2-4199-81de-c38149681be5", "content-length": "26", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
79772024-12-13T21:08:07.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79782024-12-13T21:08:07.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79792024-12-13T21:08:07.984ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79802024-12-13T21:08:07.984ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79812024-12-13T21:08:07.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e5ac928-6330-4ebe-8ab3-e179d29549e3", "content-length": "372", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
79822024-12-13T21:08:07.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79832024-12-13T21:08:07.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79842024-12-13T21:08:07.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 008115d1-2139-43d0-9c04-f4c23b90bb3d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
79852024-12-13T21:08:07.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 008115d1-2139-43d0-9c04-f4c23b90bb3d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
79862024-12-13T21:08:07.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 008115d1-2139-43d0-9c04-f4c23b90bb3d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
79872024-12-13T21:08:07.998ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
79882024-12-13T21:08:07.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79892024-12-13T21:08:08.001ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cb9ee651-a080-42a5-a4a4-214c073c7327", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
79902024-12-13T21:08:08.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79912024-12-13T21:08:08.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79922024-12-13T21:08:08.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79932024-12-13T21:08:08.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79942024-12-13T21:08:08.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79952024-12-13T21:08:08.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79962024-12-13T21:08:08.010ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79972024-12-13T21:08:08.010ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79982024-12-13T21:08:08.010ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "37bdff70-a3ac-485f-ab30-f9ad2be3e6d8", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
79992024-12-13T21:08:08.011ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.411581ms iteration = 23 status = {}
80002024-12-13T21:08:08.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
80012024-12-13T21:08:08.015ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80022024-12-13T21:08:08.015ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4de778a-3f28-4f15-914e-15439720febd", "content-length": "26", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
80032024-12-13T21:08:08.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80042024-12-13T21:08:08.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
80052024-12-13T21:08:08.081ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.667437ms iteration = 22 status = {}
80062024-12-13T21:08:08.081ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80072024-12-13T21:08:08.081ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb1e8fe6-2dee-4719-8b63-61d655ba421a", "content-length": "1", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
80082024-12-13T21:08:08.082ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80092024-12-13T21:08:08.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80102024-12-13T21:08:08.084ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 361.303371ms iteration = 22 status = null
80112024-12-13T21:08:08.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80122024-12-13T21:08:08.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80132024-12-13T21:08:08.156ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
80142024-12-13T21:08:08.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80152024-12-13T21:08:08.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80162024-12-13T21:08:08.165ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80172024-12-13T21:08:08.165ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dae829b-012d-4b0e-8ebc-0bf4f1b037cc", "content-length": "134", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
80182024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80192024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
80202024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80212024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80222024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80232024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80242024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80252024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80262024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80272024-12-13T21:08:08.165ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80282024-12-13T21:08:08.166ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
80292024-12-13T21:08:08.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80302024-12-13T21:08:08.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80312024-12-13T21:08:08.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80322024-12-13T21:08:08.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc607a97-6970-49af-92c1-e65d5183fe84", "content-length": "2", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
80332024-12-13T21:08:08.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80342024-12-13T21:08:08.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "568f4a0b-6827-40ba-b997-e47e37d6b987", "content-length": "52", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
80352024-12-13T21:08:08.167ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
80362024-12-13T21:08:08.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80372024-12-13T21:08:08.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "52351b7e-c70b-43c8-860b-dcd4303d8b2f", "date": "Fri, 13 Dec 2024 21:08:07 GMT"} })
80382024-12-13T21:08:08.257ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
80392024-12-13T21:08:08.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80402024-12-13T21:08:08.260ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c503c74a-4ea2-45a5-a9fd-922f63f2e0ba", "content-length": "682", "date": "Fri, 13 Dec 2024 21:08:08 GMT"} })
80412024-12-13T21:08:08.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80422024-12-13T21:08:08.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80432024-12-13T21:08:08.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80442024-12-13T21:08:08.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80452024-12-13T21:08:08.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80462024-12-13T21:08:08.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80472024-12-13T21:08:08.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80482024-12-13T21:08:08.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80492024-12-13T21:08:08.277ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 554.671098ms iteration = 22 status = {}
80502024-12-13T21:08:08.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = c787ad12-21e2-4040-ae4b-57d31c3e6eae roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
80512024-12-13T21:08:08.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = c787ad12-21e2-4040-ae4b-57d31c3e6eae resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
80522024-12-13T21:08:08.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = c787ad12-21e2-4040-ae4b-57d31c3e6eae response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
80532024-12-13T21:08:09.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63ed9f06-963e-4145-867c-cd1235cfa1f1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80542024-12-13T21:08:09.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63ed9f06-963e-4145-867c-cd1235cfa1f1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80552024-12-13T21:08:09.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63ed9f06-963e-4145-867c-cd1235cfa1f1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80562024-12-13T21:08:09.151ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
80572024-12-13T21:08:09.151ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
80582024-12-13T21:08:09.182ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
80592024-12-13T21:08:09.182ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:58357
80602024-12-13T21:08:09.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58357 req_id = 355b9617-75f7-401a-b8e9-a54b3e331037 roles = RoleSet { roles: {} } uri = /metrics/producers
80612024-12-13T21:08:09.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58357 req_id = 355b9617-75f7-401a-b8e9-a54b3e331037 resource = Database result = Ok(()) uri = /metrics/producers
80622024-12-13T21:08:09.190ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 0599e804-8800-4951-9d87-7a8a49a507a3
80632024-12-13T21:08:09.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7808 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58357 req_id = 355b9617-75f7-401a-b8e9-a54b3e331037 response_code = 201 uri = /metrics/producers
80642024-12-13T21:08:09.190ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "355b9617-75f7-401a-b8e9-a54b3e331037", "content-length": "41", "date": "Fri, 13 Dec 2024 21:08:09 GMT"} })
80652024-12-13T21:08:09.191ZDEBGnexus (producer-registration-task): registered with nexus successfully
80662024-12-13T21:08:09.191ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
80672024-12-13T21:08:10.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e72c43d7-c2e6-4eec-ae77-19bb4f2f4470 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80682024-12-13T21:08:10.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e72c43d7-c2e6-4eec-ae77-19bb4f2f4470 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80692024-12-13T21:08:10.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e72c43d7-c2e6-4eec-ae77-19bb4f2f4470 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80702024-12-13T21:08:11.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9b06b969-122e-497b-9a2c-78bf57ff20fa roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80712024-12-13T21:08:11.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9b06b969-122e-497b-9a2c-78bf57ff20fa resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80722024-12-13T21:08:11.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9b06b969-122e-497b-9a2c-78bf57ff20fa response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80732024-12-13T21:08:12.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb579bac-1960-468d-bdc1-5c000790943b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80742024-12-13T21:08:12.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb579bac-1960-468d-bdc1-5c000790943b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80752024-12-13T21:08:12.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb579bac-1960-468d-bdc1-5c000790943b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80762024-12-13T21:08:13.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3fa17393-3fcc-495a-bc0c-a61984bace13 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80772024-12-13T21:08:13.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3fa17393-3fcc-495a-bc0c-a61984bace13 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80782024-12-13T21:08:13.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3fa17393-3fcc-495a-bc0c-a61984bace13 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80792024-12-13T21:08:14.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd821c29-8b37-40d1-b07f-20e699a236f4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80802024-12-13T21:08:14.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd821c29-8b37-40d1-b07f-20e699a236f4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80812024-12-13T21:08:14.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dd821c29-8b37-40d1-b07f-20e699a236f4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80822024-12-13T21:08:15.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ccf3c7bf-d0a5-40af-b1e1-d155e6e57e5c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80832024-12-13T21:08:15.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ccf3c7bf-d0a5-40af-b1e1-d155e6e57e5c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80842024-12-13T21:08:15.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ccf3c7bf-d0a5-40af-b1e1-d155e6e57e5c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80852024-12-13T21:08:16.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 15d01944-d7a0-4a52-9d11-bc5942ba2fad roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80862024-12-13T21:08:16.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 15d01944-d7a0-4a52-9d11-bc5942ba2fad resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80872024-12-13T21:08:16.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 15d01944-d7a0-4a52-9d11-bc5942ba2fad response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80882024-12-13T21:08:17.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ba478619-ecf6-4217-a659-cd39de2dff0c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80892024-12-13T21:08:17.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ba478619-ecf6-4217-a659-cd39de2dff0c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80902024-12-13T21:08:17.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ba478619-ecf6-4217-a659-cd39de2dff0c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
80912024-12-13T21:08:17.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 76d2c7c5-89e6-493e-97e4-fbb1be9c4dec roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
80922024-12-13T21:08:17.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 76d2c7c5-89e6-493e-97e4-fbb1be9c4dec resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
80932024-12-13T21:08:17.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 76d2c7c5-89e6-493e-97e4-fbb1be9c4dec response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
80942024-12-13T21:08:17.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c57ff8a8-d3d4-4fd3-abed-dba5a5b91723 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
80952024-12-13T21:08:17.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c57ff8a8-d3d4-4fd3-abed-dba5a5b91723 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
80962024-12-13T21:08:17.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = c57ff8a8-d3d4-4fd3-abed-dba5a5b91723 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
80972024-12-13T21:08:17.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1155 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 3530763e-f51f-4150-8e1f-665ba18792af response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
80982024-12-13T21:08:17.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
80992024-12-13T21:08:17.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81002024-12-13T21:08:17.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
81012024-12-13T21:08:17.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81022024-12-13T21:08:17.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81032024-12-13T21:08:17.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81042024-12-13T21:08:17.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81052024-12-13T21:08:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81062024-12-13T21:08:17.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81072024-12-13T21:08:17.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.734928ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81082024-12-13T21:08:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81092024-12-13T21:08:17.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81102024-12-13T21:08:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81112024-12-13T21:08:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81122024-12-13T21:08:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81132024-12-13T21:08:17.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142024-12-13T21:08:17.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
81152024-12-13T21:08:17.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81162024-12-13T21:08:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81172024-12-13T21:08:17.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
81182024-12-13T21:08:17.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.017833ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
81192024-12-13T21:08:18.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e944525e-b51f-4594-bc92-dc94611294e0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81202024-12-13T21:08:18.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e944525e-b51f-4594-bc92-dc94611294e0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81212024-12-13T21:08:18.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e944525e-b51f-4594-bc92-dc94611294e0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81222024-12-13T21:08:19.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c9f2c06-28f3-4504-95d8-dfd5af6522da roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81232024-12-13T21:08:19.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c9f2c06-28f3-4504-95d8-dfd5af6522da resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81242024-12-13T21:08:19.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c9f2c06-28f3-4504-95d8-dfd5af6522da response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81252024-12-13T21:08:20.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 06d2474d-fb8e-4166-84a0-ad854dad76d1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81262024-12-13T21:08:20.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 06d2474d-fb8e-4166-84a0-ad854dad76d1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81272024-12-13T21:08:20.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 06d2474d-fb8e-4166-84a0-ad854dad76d1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81282024-12-13T21:08:21.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1f7ea766-6482-4c38-bbaf-8230dd8d29d0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81292024-12-13T21:08:21.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1f7ea766-6482-4c38-bbaf-8230dd8d29d0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81302024-12-13T21:08:21.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1f7ea766-6482-4c38-bbaf-8230dd8d29d0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81312024-12-13T21:08:22.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c625b47-a4f6-44e9-b5ac-2232ca387f18 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81322024-12-13T21:08:22.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c625b47-a4f6-44e9-b5ac-2232ca387f18 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81332024-12-13T21:08:22.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c625b47-a4f6-44e9-b5ac-2232ca387f18 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81342024-12-13T21:08:23.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 287e417d-6b2e-404f-a923-22611c183563 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81352024-12-13T21:08:23.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 287e417d-6b2e-404f-a923-22611c183563 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81362024-12-13T21:08:23.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 287e417d-6b2e-404f-a923-22611c183563 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81372024-12-13T21:08:24.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63ba56dd-c2f7-4333-91eb-95dbd2ad288c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81382024-12-13T21:08:24.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63ba56dd-c2f7-4333-91eb-95dbd2ad288c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81392024-12-13T21:08:24.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 63ba56dd-c2f7-4333-91eb-95dbd2ad288c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81402024-12-13T21:08:25.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82dbc370-134c-4261-8af8-9771ea76bf89 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81412024-12-13T21:08:25.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82dbc370-134c-4261-8af8-9771ea76bf89 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81422024-12-13T21:08:25.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82dbc370-134c-4261-8af8-9771ea76bf89 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81432024-12-13T21:08:26.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e57d860-3d62-4c59-9942-783a0c088f72 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81442024-12-13T21:08:26.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e57d860-3d62-4c59-9942-783a0c088f72 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81452024-12-13T21:08:26.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e57d860-3d62-4c59-9942-783a0c088f72 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81462024-12-13T21:08:27.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d1d9f8c-72b2-4194-8570-c3e844ca8d6b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81472024-12-13T21:08:27.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d1d9f8c-72b2-4194-8570-c3e844ca8d6b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81482024-12-13T21:08:27.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5d1d9f8c-72b2-4194-8570-c3e844ca8d6b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81492024-12-13T21:08:27.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1401 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 3435d144-a839-47b2-8e4b-615bd36d9426 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
81502024-12-13T21:08:27.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
81512024-12-13T21:08:27.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81522024-12-13T21:08:27.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
81532024-12-13T21:08:27.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542024-12-13T21:08:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81552024-12-13T21:08:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81562024-12-13T21:08:27.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81572024-12-13T21:08:27.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81582024-12-13T21:08:27.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81592024-12-13T21:08:27.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.48618ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81602024-12-13T21:08:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81612024-12-13T21:08:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81622024-12-13T21:08:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81632024-12-13T21:08:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81642024-12-13T21:08:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81652024-12-13T21:08:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81662024-12-13T21:08:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
81672024-12-13T21:08:27.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81682024-12-13T21:08:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81692024-12-13T21:08:27.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
81702024-12-13T21:08:27.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.714222ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
81712024-12-13T21:08:28.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7f50079-09dd-4c76-99a0-fb291e666dc5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81722024-12-13T21:08:28.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7f50079-09dd-4c76-99a0-fb291e666dc5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81732024-12-13T21:08:28.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a7f50079-09dd-4c76-99a0-fb291e666dc5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81742024-12-13T21:08:29.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e0f1ea8-e52a-4983-8d52-489c7511a8ad roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81752024-12-13T21:08:29.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e0f1ea8-e52a-4983-8d52-489c7511a8ad resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81762024-12-13T21:08:29.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7e0f1ea8-e52a-4983-8d52-489c7511a8ad response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81772024-12-13T21:08:30.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f80fe7b-fdd8-42b4-a5ee-ca0cae1c35ca roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81782024-12-13T21:08:30.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f80fe7b-fdd8-42b4-a5ee-ca0cae1c35ca resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81792024-12-13T21:08:30.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f80fe7b-fdd8-42b4-a5ee-ca0cae1c35ca response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81802024-12-13T21:08:31.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e6258710-b6cc-4c36-9c5b-a75f997a181c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81812024-12-13T21:08:31.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e6258710-b6cc-4c36-9c5b-a75f997a181c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81822024-12-13T21:08:31.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e6258710-b6cc-4c36-9c5b-a75f997a181c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81832024-12-13T21:08:32.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c858c84f-382a-4f23-9619-f1a5ee5a7b07 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81842024-12-13T21:08:32.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c858c84f-382a-4f23-9619-f1a5ee5a7b07 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81852024-12-13T21:08:32.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c858c84f-382a-4f23-9619-f1a5ee5a7b07 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81862024-12-13T21:08:33.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1b213a17-6a9c-4af3-a6bb-b8f480240459 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81872024-12-13T21:08:33.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1b213a17-6a9c-4af3-a6bb-b8f480240459 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81882024-12-13T21:08:33.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1b213a17-6a9c-4af3-a6bb-b8f480240459 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81892024-12-13T21:08:34.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f2081f05-37cb-48f8-8a58-aa374fa5f1de roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81902024-12-13T21:08:34.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f2081f05-37cb-48f8-8a58-aa374fa5f1de resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81912024-12-13T21:08:34.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f2081f05-37cb-48f8-8a58-aa374fa5f1de response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81922024-12-13T21:08:35.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 014476a0-7d5f-4c7d-a8e5-ba191b530281 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81932024-12-13T21:08:35.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 014476a0-7d5f-4c7d-a8e5-ba191b530281 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81942024-12-13T21:08:35.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 014476a0-7d5f-4c7d-a8e5-ba191b530281 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81952024-12-13T21:08:36.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f41cc918-aab8-4f92-ad49-ebc3397034a8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81962024-12-13T21:08:36.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f41cc918-aab8-4f92-ad49-ebc3397034a8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81972024-12-13T21:08:36.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f41cc918-aab8-4f92-ad49-ebc3397034a8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
81982024-12-13T21:08:37.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 73731b0b-d921-428b-ac97-a016f6e014a5 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
81992024-12-13T21:08:37.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c176148f-2466-43e9-a58e-19ed37fb2f25 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
82002024-12-13T21:08:37.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c176148f-2466-43e9-a58e-19ed37fb2f25 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
82012024-12-13T21:08:37.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c176148f-2466-43e9-a58e-19ed37fb2f25 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
82022024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
82032024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
82042024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82052024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
82062024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82072024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
82082024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82092024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82102024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82112024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
82122024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
82132024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
82142024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
82152024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82162024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82172024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82182024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82192024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
82202024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
82212024-12-13T21:08:37.722ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:58:37.722677550 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82222024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82232024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
82242024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82252024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82262024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
82272024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82282024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
82292024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82302024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
82312024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82322024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
82332024-12-13T21:08:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
82342024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82352024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
82362024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82372024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
82382024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82392024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
82402024-12-13T21:08:37.723ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
82412024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
82422024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82432024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
82442024-12-13T21:08:37.723ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
82452024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.741\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
82462024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
82472024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
82482024-12-13T21:08:37.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82492024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
82502024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82512024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82522024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82532024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82542024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82552024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82562024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
82572024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82582024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82592024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82602024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
82612024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
82622024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82632024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82642024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
82652024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82662024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
82672024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82682024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
82692024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82702024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82712024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
82722024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82732024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82742024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82752024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82762024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82772024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82782024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82792024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82802024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82812024-12-13T21:08:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82822024-12-13T21:08:37.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 238493594 } })
82832024-12-13T21:08:37.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 238669768 } })
82842024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82852024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
82862024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
82872024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82882024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82892024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
82902024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
82912024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.539971ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
82922024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
82932024-12-13T21:08:37.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.53569ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
82942024-12-13T21:08:37.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82952024-12-13T21:08:37.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82962024-12-13T21:08:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82972024-12-13T21:08:37.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82982024-12-13T21:08:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82992024-12-13T21:08:37.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.684801ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83002024-12-13T21:08:37.727ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:58:37.722677550 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83012024-12-13T21:08:37.727ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.919458ms iteration = 12 status = {"expiration":"2024-12-13T20:58:37.722677550Z","pruned":[]}
83022024-12-13T21:08:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83032024-12-13T21:08:37.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83042024-12-13T21:08:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83052024-12-13T21:08:37.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83062024-12-13T21:08:37.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83072024-12-13T21:08:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83082024-12-13T21:08:37.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83092024-12-13T21:08:37.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83102024-12-13T21:08:37.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83112024-12-13T21:08:37.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83122024-12-13T21:08:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83132024-12-13T21:08:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83142024-12-13T21:08:37.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83152024-12-13T21:08:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83162024-12-13T21:08:37.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83172024-12-13T21:08:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83182024-12-13T21:08:37.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83192024-12-13T21:08:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83202024-12-13T21:08:37.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 250361542 } })
83212024-12-13T21:08:37.735ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
83222024-12-13T21:08:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83232024-12-13T21:08:37.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83242024-12-13T21:08:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83252024-12-13T21:08:37.737ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83262024-12-13T21:08:37.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83272024-12-13T21:08:37.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
83282024-12-13T21:08:37.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83292024-12-13T21:08:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83302024-12-13T21:08:37.739ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83312024-12-13T21:08:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83322024-12-13T21:08:37.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83332024-12-13T21:08:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83342024-12-13T21:08:37.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83352024-12-13T21:08:37.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83362024-12-13T21:08:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83372024-12-13T21:08:37.741ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 255906486 } })
83382024-12-13T21:08:37.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392024-12-13T21:08:37.741ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
83402024-12-13T21:08:37.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.941235ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
83412024-12-13T21:08:37.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.600512ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
83422024-12-13T21:08:37.742ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83432024-12-13T21:08:37.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83442024-12-13T21:08:37.743ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83452024-12-13T21:08:37.743ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83462024-12-13T21:08:37.743ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 19.755292ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83472024-12-13T21:08:37.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83482024-12-13T21:08:37.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83492024-12-13T21:08:37.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83502024-12-13T21:08:37.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83512024-12-13T21:08:37.745ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.318939ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
83522024-12-13T21:08:37.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83532024-12-13T21:08:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83542024-12-13T21:08:37.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83552024-12-13T21:08:37.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83562024-12-13T21:08:37.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83572024-12-13T21:08:37.751ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 266359097 } })
83582024-12-13T21:08:37.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83592024-12-13T21:08:37.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
83602024-12-13T21:08:37.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83612024-12-13T21:08:37.753ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83622024-12-13T21:08:37.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83632024-12-13T21:08:37.754ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83642024-12-13T21:08:37.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83652024-12-13T21:08:37.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83662024-12-13T21:08:37.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
83672024-12-13T21:08:37.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83682024-12-13T21:08:37.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83692024-12-13T21:08:37.763ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83702024-12-13T21:08:37.763ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83712024-12-13T21:08:37.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83722024-12-13T21:08:37.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83732024-12-13T21:08:37.775ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83742024-12-13T21:08:37.775ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83752024-12-13T21:08:37.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83762024-12-13T21:08:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83772024-12-13T21:08:37.784ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
83782024-12-13T21:08:37.784ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.481015ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
83792024-12-13T21:08:37.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83802024-12-13T21:08:37.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83812024-12-13T21:08:37.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83822024-12-13T21:08:37.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83832024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.677876ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83842024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83852024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83862024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
83872024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
83882024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
83892024-12-13T21:08:37.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83902024-12-13T21:08:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83912024-12-13T21:08:37.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83922024-12-13T21:08:37.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83932024-12-13T21:08:37.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83942024-12-13T21:08:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83952024-12-13T21:08:37.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83962024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
83972024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83982024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83992024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84012024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84022024-12-13T21:08:37.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84032024-12-13T21:08:37.798ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.020462ms iteration = 23 status = 0
84042024-12-13T21:08:37.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84052024-12-13T21:08:37.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84062024-12-13T21:08:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84072024-12-13T21:08:37.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84082024-12-13T21:08:37.800ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84092024-12-13T21:08:37.800ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.300105ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84102024-12-13T21:08:37.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112024-12-13T21:08:37.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84122024-12-13T21:08:37.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.854721ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84132024-12-13T21:08:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84142024-12-13T21:08:37.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84152024-12-13T21:08:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84162024-12-13T21:08:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 81.390151ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
84172024-12-13T21:08:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84182024-12-13T21:08:37.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84192024-12-13T21:08:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84202024-12-13T21:08:37.805ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84212024-12-13T21:08:37.805ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84222024-12-13T21:08:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.728556ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84232024-12-13T21:08:37.810ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84242024-12-13T21:08:37.810ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84252024-12-13T21:08:37.810ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.561652ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84262024-12-13T21:08:37.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.25467ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84272024-12-13T21:08:37.827ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84282024-12-13T21:08:37.827ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
84292024-12-13T21:08:37.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84302024-12-13T21:08:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84312024-12-13T21:08:37.834ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84322024-12-13T21:08:37.834ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84332024-12-13T21:08:37.834ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84342024-12-13T21:08:37.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84352024-12-13T21:08:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84362024-12-13T21:08:37.855ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
84372024-12-13T21:08:37.855ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 132.834926ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
84382024-12-13T21:08:37.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
84392024-12-13T21:08:37.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84402024-12-13T21:08:37.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84412024-12-13T21:08:37.976ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
84422024-12-13T21:08:38.014ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84432024-12-13T21:08:38.014ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84442024-12-13T21:08:38.015ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d62a635a-0035-4b0c-ad99-f335afe3fcb6", "content-length": "372", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} })
84452024-12-13T21:08:38.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84462024-12-13T21:08:38.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84472024-12-13T21:08:38.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84482024-12-13T21:08:38.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84492024-12-13T21:08:38.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84502024-12-13T21:08:38.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84512024-12-13T21:08:38.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84522024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84532024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84542024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84552024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84562024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84572024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84582024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84592024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84602024-12-13T21:08:38.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84612024-12-13T21:08:38.025ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
84622024-12-13T21:08:38.025ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84632024-12-13T21:08:38.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84642024-12-13T21:08:38.025ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1b18fa-b5b1-4cb1-823d-7faa870daa18", "content-length": "26", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
84652024-12-13T21:08:38.025ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84662024-12-13T21:08:38.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84672024-12-13T21:08:38.025ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
84682024-12-13T21:08:38.025ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
84692024-12-13T21:08:38.025ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
84702024-12-13T21:08:38.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.230875ms iteration = 13 status = {"generation":2}
84712024-12-13T21:08:38.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84722024-12-13T21:08:38.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84732024-12-13T21:08:38.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84742024-12-13T21:08:38.028ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
84752024-12-13T21:08:38.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84762024-12-13T21:08:38.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84772024-12-13T21:08:38.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84782024-12-13T21:08:38.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84792024-12-13T21:08:38.034ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84802024-12-13T21:08:38.034ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8828a9eb-4b36-4c51-b4ab-a4e5605f9637", "content-length": "26", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
84812024-12-13T21:08:38.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84822024-12-13T21:08:38.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84832024-12-13T21:08:38.054ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84842024-12-13T21:08:38.054ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84852024-12-13T21:08:38.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84862024-12-13T21:08:38.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84872024-12-13T21:08:38.079ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
84882024-12-13T21:08:38.079ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84892024-12-13T21:08:38.080ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52b1b62c-0eed-43b5-a0cf-aede3240f359", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} })
84902024-12-13T21:08:38.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84912024-12-13T21:08:38.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84922024-12-13T21:08:38.080ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84932024-12-13T21:08:38.080ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84942024-12-13T21:08:38.081ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b486dd4c-0794-4c95-bcd1-d08f04f5b60b", "content-length": "26", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
84952024-12-13T21:08:38.081ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84962024-12-13T21:08:38.081ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
84972024-12-13T21:08:38.081ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 358.728044ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
84982024-12-13T21:08:38.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84992024-12-13T21:08:38.082ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85002024-12-13T21:08:38.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85012024-12-13T21:08:38.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85022024-12-13T21:08:38.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85032024-12-13T21:08:38.089ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85042024-12-13T21:08:38.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85052024-12-13T21:08:38.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "20bd9b81-6899-4385-9ec1-5f00104730ff", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} })
85062024-12-13T21:08:38.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.222077ms iteration = 24 status = {}
85072024-12-13T21:08:38.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85082024-12-13T21:08:38.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85092024-12-13T21:08:38.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85102024-12-13T21:08:38.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85112024-12-13T21:08:38.103ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
85122024-12-13T21:08:38.103ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85132024-12-13T21:08:38.103ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
85142024-12-13T21:08:38.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 380.635243ms iteration = 13 status = {"generation":1}
85152024-12-13T21:08:38.111ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85162024-12-13T21:08:38.118ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 396.135084ms iteration = 27 status = {"physical_disks_added":0}
85172024-12-13T21:08:38.168ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 446.191983ms iteration = 23 status = {}
85182024-12-13T21:08:38.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
85192024-12-13T21:08:38.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cce4185e-7598-4135-9d9e-5065157d54bf", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85202024-12-13T21:08:38.211ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85212024-12-13T21:08:38.213ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4d130f27-c195-45af-b74d-d48c5a5449a1", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85222024-12-13T21:08:38.213ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85232024-12-13T21:08:38.215ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
85242024-12-13T21:08:38.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 493.061079ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85252024-12-13T21:08:38.225ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85262024-12-13T21:08:38.226ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c30ed8ab-8df9-46bd-ba16-42fb50533422", "content-length": "1", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
85272024-12-13T21:08:38.227ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85282024-12-13T21:08:38.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85292024-12-13T21:08:38.229ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 506.617161ms iteration = 23 status = null
85302024-12-13T21:08:38.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85312024-12-13T21:08:38.273ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e4c5c8f-c2eb-4035-83da-f22ba5fdb647", "content-length": "691", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} })
85322024-12-13T21:08:38.273ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85332024-12-13T21:08:38.273ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85342024-12-13T21:08:38.273ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85352024-12-13T21:08:38.273ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 550.845458ms iteration = 23 status = {}
85362024-12-13T21:08:38.299ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85372024-12-13T21:08:38.299ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "aac6400f-9be7-466c-acdd-3975f3f3ed33", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85382024-12-13T21:08:38.299ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85392024-12-13T21:08:38.300ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a435c9cb-12f7-4a9a-9e93-07e720431548", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85402024-12-13T21:08:38.300ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85412024-12-13T21:08:38.302ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1c9cbb72-dcd4-4250-8fe7-e81a27f359d9", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85422024-12-13T21:08:38.302ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85432024-12-13T21:08:38.303ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
85442024-12-13T21:08:38.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 581.02625ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85452024-12-13T21:08:38.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85462024-12-13T21:08:38.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85472024-12-13T21:08:38.355ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
85482024-12-13T21:08:38.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85492024-12-13T21:08:38.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85502024-12-13T21:08:38.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85512024-12-13T21:08:38.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "85257246-5c1b-44bd-a3ac-3957844beef9", "content-length": "134", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
85522024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85532024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
85542024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85552024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85562024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85572024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85582024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85592024-12-13T21:08:38.363ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85602024-12-13T21:08:38.364ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85612024-12-13T21:08:38.364ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85622024-12-13T21:08:38.364ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
85632024-12-13T21:08:38.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85642024-12-13T21:08:38.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85652024-12-13T21:08:38.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85662024-12-13T21:08:38.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba3bf22f-e8d4-4452-bb35-5a0426128438", "content-length": "2", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
85672024-12-13T21:08:38.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85682024-12-13T21:08:38.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3811ed17-df44-4c07-85d3-3526717a1aeb", "content-length": "52", "date": "Fri, 13 Dec 2024 21:08:37 GMT"} })
85692024-12-13T21:08:38.366ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
85702024-12-13T21:08:38.366ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85712024-12-13T21:08:38.466ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a28a1c45-9398-4068-a109-f046aba8cf7f", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} })
85722024-12-13T21:08:38.466ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
85732024-12-13T21:08:38.466ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85742024-12-13T21:08:38.470ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "91db1880-1f1e-4177-89a1-edfad7d2cf6b", "content-length": "682", "date": "Fri, 13 Dec 2024 21:08:38 GMT"} })
85752024-12-13T21:08:38.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85762024-12-13T21:08:38.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85772024-12-13T21:08:38.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85782024-12-13T21:08:38.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85792024-12-13T21:08:38.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85802024-12-13T21:08:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85812024-12-13T21:08:38.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85822024-12-13T21:08:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85832024-12-13T21:08:38.487ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 764.577371ms iteration = 23 status = {}
85842024-12-13T21:08:38.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ef7fd35b-b26e-4494-9e16-fff2d74355bb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
85852024-12-13T21:08:38.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ef7fd35b-b26e-4494-9e16-fff2d74355bb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
85862024-12-13T21:08:38.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ef7fd35b-b26e-4494-9e16-fff2d74355bb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
85872024-12-13T21:08:38.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3e963274-15a3-46c7-aca4-f7cd70f6638e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85882024-12-13T21:08:38.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3e963274-15a3-46c7-aca4-f7cd70f6638e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85892024-12-13T21:08:38.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3e963274-15a3-46c7-aca4-f7cd70f6638e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85902024-12-13T21:08:39.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3576347e-c12c-4669-9bac-27a0935fd81c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85912024-12-13T21:08:39.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3576347e-c12c-4669-9bac-27a0935fd81c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85922024-12-13T21:08:39.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3576347e-c12c-4669-9bac-27a0935fd81c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85932024-12-13T21:08:40.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fc199672-5ff5-4af6-888c-057134269310 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85942024-12-13T21:08:40.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fc199672-5ff5-4af6-888c-057134269310 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85952024-12-13T21:08:40.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fc199672-5ff5-4af6-888c-057134269310 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85962024-12-13T21:08:41.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 53441312-5b42-4b9c-8cb0-88b11f6f12a6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85972024-12-13T21:08:41.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 53441312-5b42-4b9c-8cb0-88b11f6f12a6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85982024-12-13T21:08:41.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 53441312-5b42-4b9c-8cb0-88b11f6f12a6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
85992024-12-13T21:08:42.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3a14420-08d2-40f9-822d-19d173bfc0a8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86002024-12-13T21:08:42.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3a14420-08d2-40f9-822d-19d173bfc0a8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86012024-12-13T21:08:42.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3a14420-08d2-40f9-822d-19d173bfc0a8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86022024-12-13T21:08:43.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 20f8d904-38a4-4c14-94a3-51225f6b0a6b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86032024-12-13T21:08:43.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 20f8d904-38a4-4c14-94a3-51225f6b0a6b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86042024-12-13T21:08:43.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 20f8d904-38a4-4c14-94a3-51225f6b0a6b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86052024-12-13T21:08:44.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 843b6836-0f43-4f13-a254-11218a401280 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86062024-12-13T21:08:44.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 843b6836-0f43-4f13-a254-11218a401280 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86072024-12-13T21:08:44.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 843b6836-0f43-4f13-a254-11218a401280 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86082024-12-13T21:08:45.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5f972bbf-ec70-46a6-923c-b9658d74526f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86092024-12-13T21:08:45.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5f972bbf-ec70-46a6-923c-b9658d74526f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86102024-12-13T21:08:45.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5f972bbf-ec70-46a6-923c-b9658d74526f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86112024-12-13T21:08:46.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a1ce60f-7515-47dc-a181-edf36a6ca73b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86122024-12-13T21:08:46.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a1ce60f-7515-47dc-a181-edf36a6ca73b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86132024-12-13T21:08:46.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a1ce60f-7515-47dc-a181-edf36a6ca73b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86142024-12-13T21:08:47.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 1a738b31-5b83-41a0-81e4-571cedc9076a roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
86152024-12-13T21:08:47.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 1a738b31-5b83-41a0-81e4-571cedc9076a resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
86162024-12-13T21:08:47.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 1a738b31-5b83-41a0-81e4-571cedc9076a response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
86172024-12-13T21:08:47.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = fca399b8-274b-40ed-a09a-ed9ad714b936 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
86182024-12-13T21:08:47.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = fca399b8-274b-40ed-a09a-ed9ad714b936 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
86192024-12-13T21:08:47.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = fca399b8-274b-40ed-a09a-ed9ad714b936 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
86202024-12-13T21:08:47.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1153 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = dcca3d5a-25a8-40cb-874d-c9b65a0ea010 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
86212024-12-13T21:08:47.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
86222024-12-13T21:08:47.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86232024-12-13T21:08:47.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
86242024-12-13T21:08:47.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86252024-12-13T21:08:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86262024-12-13T21:08:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86272024-12-13T21:08:47.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86282024-12-13T21:08:47.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86292024-12-13T21:08:47.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86302024-12-13T21:08:47.752ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.533572ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86312024-12-13T21:08:47.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86322024-12-13T21:08:47.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86332024-12-13T21:08:47.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86342024-12-13T21:08:47.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86352024-12-13T21:08:47.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86362024-12-13T21:08:47.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86372024-12-13T21:08:47.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
86382024-12-13T21:08:47.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86392024-12-13T21:08:47.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86402024-12-13T21:08:47.771ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
86412024-12-13T21:08:47.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.407742ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
86422024-12-13T21:08:47.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ded295ef-7969-4f90-aaab-6995eb32de14 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86432024-12-13T21:08:47.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ded295ef-7969-4f90-aaab-6995eb32de14 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86442024-12-13T21:08:47.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ded295ef-7969-4f90-aaab-6995eb32de14 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86452024-12-13T21:08:48.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d7d184d8-a46e-4591-a04d-ccadfd9b66f6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86462024-12-13T21:08:48.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d7d184d8-a46e-4591-a04d-ccadfd9b66f6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86472024-12-13T21:08:48.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d7d184d8-a46e-4591-a04d-ccadfd9b66f6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86482024-12-13T21:08:49.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 05474fd1-a4e4-46ef-a738-3c93903a5a4e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86492024-12-13T21:08:49.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 05474fd1-a4e4-46ef-a738-3c93903a5a4e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86502024-12-13T21:08:49.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 05474fd1-a4e4-46ef-a738-3c93903a5a4e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86512024-12-13T21:08:50.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ff6415d-116e-49e9-b259-5a1f6086e81e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86522024-12-13T21:08:50.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ff6415d-116e-49e9-b259-5a1f6086e81e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86532024-12-13T21:08:50.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ff6415d-116e-49e9-b259-5a1f6086e81e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86542024-12-13T21:08:52.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4cf5a5d-bbfa-477a-90c2-2d392e21c0df roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86552024-12-13T21:08:52.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4cf5a5d-bbfa-477a-90c2-2d392e21c0df resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86562024-12-13T21:08:52.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d4cf5a5d-bbfa-477a-90c2-2d392e21c0df response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86572024-12-13T21:08:53.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ac0a118-f1ea-4841-b0f0-f29bba3abeb5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86582024-12-13T21:08:53.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ac0a118-f1ea-4841-b0f0-f29bba3abeb5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86592024-12-13T21:08:53.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1ac0a118-f1ea-4841-b0f0-f29bba3abeb5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86602024-12-13T21:08:54.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3d0d432-b5a2-4f43-a74b-4cdec613dc9b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86612024-12-13T21:08:54.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3d0d432-b5a2-4f43-a74b-4cdec613dc9b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86622024-12-13T21:08:54.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3d0d432-b5a2-4f43-a74b-4cdec613dc9b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86632024-12-13T21:08:55.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fad01e8c-b03f-469e-b483-07299f5ffd4d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86642024-12-13T21:08:55.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fad01e8c-b03f-469e-b483-07299f5ffd4d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86652024-12-13T21:08:55.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fad01e8c-b03f-469e-b483-07299f5ffd4d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86662024-12-13T21:08:56.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4263b93a-eb26-482b-92b2-7cddd5215a9b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86672024-12-13T21:08:56.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4263b93a-eb26-482b-92b2-7cddd5215a9b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86682024-12-13T21:08:56.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4263b93a-eb26-482b-92b2-7cddd5215a9b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86692024-12-13T21:08:57.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b587d2b3-9e37-4e6a-95eb-72a9cf9ccfb9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86702024-12-13T21:08:57.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b587d2b3-9e37-4e6a-95eb-72a9cf9ccfb9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86712024-12-13T21:08:57.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b587d2b3-9e37-4e6a-95eb-72a9cf9ccfb9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86722024-12-13T21:08:57.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a25e0c5d-2572-4798-ba40-a475999aa49d response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
86732024-12-13T21:08:57.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
86742024-12-13T21:08:57.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86752024-12-13T21:08:57.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
86762024-12-13T21:08:57.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86772024-12-13T21:08:57.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86782024-12-13T21:08:57.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86792024-12-13T21:08:57.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86802024-12-13T21:08:57.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86812024-12-13T21:08:57.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86822024-12-13T21:08:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86832024-12-13T21:08:57.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86842024-12-13T21:08:57.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86852024-12-13T21:08:57.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86862024-12-13T21:08:57.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
86872024-12-13T21:08:57.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86882024-12-13T21:08:57.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86892024-12-13T21:08:57.743ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
86902024-12-13T21:08:57.743ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.912402ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
86912024-12-13T21:08:57.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86922024-12-13T21:08:57.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86932024-12-13T21:08:57.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.308624ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86942024-12-13T21:08:58.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3238bbea-a266-401c-a0da-b5cd7448f1fc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86952024-12-13T21:08:58.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3238bbea-a266-401c-a0da-b5cd7448f1fc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86962024-12-13T21:08:58.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3238bbea-a266-401c-a0da-b5cd7448f1fc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86972024-12-13T21:08:59.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 013c373c-0491-4ccd-84a3-779813ce58a3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86982024-12-13T21:08:59.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 013c373c-0491-4ccd-84a3-779813ce58a3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
86992024-12-13T21:08:59.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 013c373c-0491-4ccd-84a3-779813ce58a3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87002024-12-13T21:09:00.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b13f2b42-7be6-4b50-b074-14b42ebb5452 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87012024-12-13T21:09:00.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b13f2b42-7be6-4b50-b074-14b42ebb5452 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87022024-12-13T21:09:00.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b13f2b42-7be6-4b50-b074-14b42ebb5452 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87032024-12-13T21:09:01.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 914e168a-8eaa-4fab-92ca-4a595a80d977 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87042024-12-13T21:09:01.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 914e168a-8eaa-4fab-92ca-4a595a80d977 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87052024-12-13T21:09:01.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 914e168a-8eaa-4fab-92ca-4a595a80d977 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87062024-12-13T21:09:02.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d529eae1-f633-4cfd-b335-daccc5b26313 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87072024-12-13T21:09:02.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d529eae1-f633-4cfd-b335-daccc5b26313 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87082024-12-13T21:09:02.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d529eae1-f633-4cfd-b335-daccc5b26313 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87092024-12-13T21:09:03.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0ee3ac5-f859-4bd7-971e-d8b1889ce12b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87102024-12-13T21:09:03.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0ee3ac5-f859-4bd7-971e-d8b1889ce12b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87112024-12-13T21:09:03.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0ee3ac5-f859-4bd7-971e-d8b1889ce12b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87122024-12-13T21:09:04.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eaf6c86f-c2c2-4b55-9026-0a3413e3d359 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87132024-12-13T21:09:04.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eaf6c86f-c2c2-4b55-9026-0a3413e3d359 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87142024-12-13T21:09:04.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = eaf6c86f-c2c2-4b55-9026-0a3413e3d359 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87152024-12-13T21:09:05.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a900547-ae42-4b8f-a0fa-0bd28b763ad3 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87162024-12-13T21:09:05.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a900547-ae42-4b8f-a0fa-0bd28b763ad3 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87172024-12-13T21:09:05.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6a900547-ae42-4b8f-a0fa-0bd28b763ad3 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87182024-12-13T21:09:06.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e60060f-0780-49ed-96aa-a20222bf3fde roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87192024-12-13T21:09:06.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e60060f-0780-49ed-96aa-a20222bf3fde resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87202024-12-13T21:09:06.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e60060f-0780-49ed-96aa-a20222bf3fde response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87212024-12-13T21:09:07.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3ea57c57-6864-4c46-ae00-b998ac5a6fbf roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87222024-12-13T21:09:07.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3ea57c57-6864-4c46-ae00-b998ac5a6fbf resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87232024-12-13T21:09:07.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3ea57c57-6864-4c46-ae00-b998ac5a6fbf response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
87242024-12-13T21:09:07.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1474 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d519734c-cff1-41ef-a0b2-eecdf7bb4cd8 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
87252024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
87262024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87272024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
87282024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
87292024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87302024-12-13T21:09:07.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87312024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
87322024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87332024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87342024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
87352024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87362024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
87372024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
87382024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87392024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
87402024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87412024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87422024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
87432024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87442024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
87452024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87462024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
87472024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87482024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
87492024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87502024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87512024-12-13T21:09:07.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
87522024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87532024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87542024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87552024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87562024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87572024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87582024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87592024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87602024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87612024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87622024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87632024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87642024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
87652024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
87662024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87672024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87682024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
87692024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87702024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
87712024-12-13T21:09:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87722024-12-13T21:09:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87732024-12-13T21:09:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87742024-12-13T21:09:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87752024-12-13T21:09:07.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87762024-12-13T21:09:07.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87772024-12-13T21:09:07.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 241200687 } })
87782024-12-13T21:09:07.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
87792024-12-13T21:09:07.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87802024-12-13T21:09:07.726ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.067246ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87812024-12-13T21:09:07.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87822024-12-13T21:09:07.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87832024-12-13T21:09:07.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87842024-12-13T21:09:07.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87852024-12-13T21:09:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87862024-12-13T21:09:07.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87872024-12-13T21:09:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87882024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87892024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87902024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87912024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87922024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87932024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87942024-12-13T21:09:07.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87952024-12-13T21:09:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87962024-12-13T21:09:07.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87972024-12-13T21:09:07.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 246018012 } })
87982024-12-13T21:09:07.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87992024-12-13T21:09:07.731ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88002024-12-13T21:09:07.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88012024-12-13T21:09:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88022024-12-13T21:09:07.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88032024-12-13T21:09:07.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88042024-12-13T21:09:07.733ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88052024-12-13T21:09:07.733ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88062024-12-13T21:09:07.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88072024-12-13T21:09:07.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88082024-12-13T21:09:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88092024-12-13T21:09:07.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88102024-12-13T21:09:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88112024-12-13T21:09:07.735ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.619442ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
88122024-12-13T21:09:07.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88132024-12-13T21:09:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88142024-12-13T21:09:07.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88152024-12-13T21:09:07.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88162024-12-13T21:09:07.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172024-12-13T21:09:07.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88182024-12-13T21:09:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88192024-12-13T21:09:07.740ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 255281172 } })
88202024-12-13T21:09:07.740ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
88212024-12-13T21:09:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88222024-12-13T21:09:07.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88232024-12-13T21:09:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88242024-12-13T21:09:07.742ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88252024-12-13T21:09:07.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.685831ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88262024-12-13T21:09:07.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88272024-12-13T21:09:07.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88282024-12-13T21:09:07.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88292024-12-13T21:09:07.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.114048ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
88302024-12-13T21:09:07.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88312024-12-13T21:09:07.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88322024-12-13T21:09:07.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.154431ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88332024-12-13T21:09:07.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88342024-12-13T21:09:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88352024-12-13T21:09:07.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88362024-12-13T21:09:07.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88372024-12-13T21:09:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88382024-12-13T21:09:07.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88392024-12-13T21:09:07.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88402024-12-13T21:09:07.780ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88412024-12-13T21:09:07.780ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88422024-12-13T21:09:07.780ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88432024-12-13T21:09:07.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88442024-12-13T21:09:07.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88452024-12-13T21:09:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88462024-12-13T21:09:07.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88472024-12-13T21:09:07.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.414407ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88482024-12-13T21:09:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
88492024-12-13T21:09:07.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88502024-12-13T21:09:07.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88512024-12-13T21:09:07.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
88522024-12-13T21:09:07.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.84754ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
88532024-12-13T21:09:07.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88542024-12-13T21:09:07.808ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88552024-12-13T21:09:07.808ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "571418b0-6a5d-40ca-8ee0-e9455815005a", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
88562024-12-13T21:09:07.808ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88572024-12-13T21:09:07.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88582024-12-13T21:09:07.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88592024-12-13T21:09:07.812ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88602024-12-13T21:09:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88612024-12-13T21:09:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
88622024-12-13T21:09:07.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88632024-12-13T21:09:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88642024-12-13T21:09:07.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.0648ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88652024-12-13T21:09:07.818ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.886856ms iteration = 24 status = 0
88662024-12-13T21:09:07.821ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88672024-12-13T21:09:07.821ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88682024-12-13T21:09:07.821ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.07572ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88692024-12-13T21:09:07.827ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88702024-12-13T21:09:07.827ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88712024-12-13T21:09:07.827ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f81b3154-d1d0-47d0-b826-98bded9990e6", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
88722024-12-13T21:09:07.827ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88732024-12-13T21:09:07.829ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88742024-12-13T21:09:07.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
88752024-12-13T21:09:07.839ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88762024-12-13T21:09:07.839ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3ccf692-e0a0-4772-9a8d-ab261501308f", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
88772024-12-13T21:09:07.839ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88782024-12-13T21:09:07.841ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
88792024-12-13T21:09:07.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.458381ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
88802024-12-13T21:09:07.848ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.050369ms iteration = 28 status = {"physical_disks_added":0}
88812024-12-13T21:09:07.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88822024-12-13T21:09:07.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88832024-12-13T21:09:07.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88842024-12-13T21:09:07.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88852024-12-13T21:09:07.889ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88862024-12-13T21:09:07.889ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1905c80c-3499-4fb4-9d33-3af66ca0c1ba", "content-length": "1", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
88872024-12-13T21:09:07.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88882024-12-13T21:09:07.891ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88892024-12-13T21:09:07.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88902024-12-13T21:09:07.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88912024-12-13T21:09:07.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88922024-12-13T21:09:07.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88932024-12-13T21:09:07.916ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 193.383226ms iteration = 24 status = {}
88942024-12-13T21:09:07.936ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88952024-12-13T21:09:07.936ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88962024-12-13T21:09:07.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb6c9dc-aabc-4915-a8ea-1e5adc0ac51f", "content-length": "372", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
88972024-12-13T21:09:07.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88982024-12-13T21:09:07.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88992024-12-13T21:09:07.938ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.682744ms iteration = 24 status = null
89002024-12-13T21:09:07.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89012024-12-13T21:09:07.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89022024-12-13T21:09:07.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89032024-12-13T21:09:07.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89042024-12-13T21:09:07.957ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
89052024-12-13T21:09:07.957ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89062024-12-13T21:09:07.957ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "70d57da6-d83f-4c3b-92ea-b6613cd970f4", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89072024-12-13T21:09:07.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89082024-12-13T21:09:07.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89092024-12-13T21:09:07.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89102024-12-13T21:09:07.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89112024-12-13T21:09:07.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89122024-12-13T21:09:07.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89132024-12-13T21:09:07.970ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89142024-12-13T21:09:07.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89152024-12-13T21:09:07.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15e4b408-bddc-4562-9deb-da74cc899729", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89162024-12-13T21:09:07.972ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.615575ms iteration = 25 status = {}
89172024-12-13T21:09:08.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89182024-12-13T21:09:08.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89192024-12-13T21:09:08.030ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
89202024-12-13T21:09:08.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89212024-12-13T21:09:08.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89222024-12-13T21:09:08.047ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89232024-12-13T21:09:08.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccaac9dd-e0d3-4fbe-89d5-d444079494c8", "content-length": "691", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89242024-12-13T21:09:08.048ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
89252024-12-13T21:09:08.048ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89262024-12-13T21:09:08.048ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89272024-12-13T21:09:08.050ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 327.385062ms iteration = 24 status = {}
89282024-12-13T21:09:08.057ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89292024-12-13T21:09:08.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "230386a4-950e-4bb3-8584-702ce224a3d3", "content-length": "134", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89302024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89312024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
89322024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89332024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89342024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89352024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89362024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89372024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89382024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89392024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89402024-12-13T21:09:08.058ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
89412024-12-13T21:09:08.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89422024-12-13T21:09:08.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89432024-12-13T21:09:08.060ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89442024-12-13T21:09:08.060ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "233e73fa-b372-4154-a149-492f6478f622", "content-length": "2", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89452024-12-13T21:09:08.060ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89462024-12-13T21:09:08.061ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ca420f3-cb0b-4fd9-ab33-599b19a49d88", "content-length": "52", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89472024-12-13T21:09:08.061ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
89482024-12-13T21:09:08.061ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89492024-12-13T21:09:08.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b7f6804f-1e9e-403e-b812-fc00b14dd14a", "date": "Fri, 13 Dec 2024 21:09:07 GMT"} })
89502024-12-13T21:09:08.148ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
89512024-12-13T21:09:08.148ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89522024-12-13T21:09:08.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "81bdd574-bbc4-49d5-be6a-2746600d1cf7", "content-length": "682", "date": "Fri, 13 Dec 2024 21:09:08 GMT"} })
89532024-12-13T21:09:08.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89542024-12-13T21:09:08.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89552024-12-13T21:09:08.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89562024-12-13T21:09:08.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89572024-12-13T21:09:08.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89582024-12-13T21:09:08.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89592024-12-13T21:09:08.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89602024-12-13T21:09:08.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89612024-12-13T21:09:08.166ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 443.161605ms iteration = 24 status = {}
89622024-12-13T21:09:08.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c7358ea-4701-4668-a228-973406072e28 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89632024-12-13T21:09:08.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c7358ea-4701-4668-a228-973406072e28 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89642024-12-13T21:09:08.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9c7358ea-4701-4668-a228-973406072e28 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89652024-12-13T21:09:08.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = a6cd4f49-eb45-4496-9c0b-870d5ec4d7f8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
89662024-12-13T21:09:08.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = a6cd4f49-eb45-4496-9c0b-870d5ec4d7f8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
89672024-12-13T21:09:08.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = a6cd4f49-eb45-4496-9c0b-870d5ec4d7f8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
89682024-12-13T21:09:09.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92ea764e-f7aa-4d65-9950-de8a499ce8f4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89692024-12-13T21:09:09.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92ea764e-f7aa-4d65-9950-de8a499ce8f4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89702024-12-13T21:09:09.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 92ea764e-f7aa-4d65-9950-de8a499ce8f4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89712024-12-13T21:09:10.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c17c45f5-4f91-4fe9-9335-9f6209cbb196 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89722024-12-13T21:09:10.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c17c45f5-4f91-4fe9-9335-9f6209cbb196 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89732024-12-13T21:09:10.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c17c45f5-4f91-4fe9-9335-9f6209cbb196 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89742024-12-13T21:09:11.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9269893b-b5c1-4507-bb89-34f81b53bcba roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89752024-12-13T21:09:11.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9269893b-b5c1-4507-bb89-34f81b53bcba resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89762024-12-13T21:09:11.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9269893b-b5c1-4507-bb89-34f81b53bcba response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89772024-12-13T21:09:12.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5afbced-d2bf-4f15-a4ea-132c902878e0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89782024-12-13T21:09:12.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5afbced-d2bf-4f15-a4ea-132c902878e0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89792024-12-13T21:09:12.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5afbced-d2bf-4f15-a4ea-132c902878e0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89802024-12-13T21:09:13.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 406842a4-90f7-4bc6-bf9c-2215a14e1feb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89812024-12-13T21:09:13.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 406842a4-90f7-4bc6-bf9c-2215a14e1feb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89822024-12-13T21:09:13.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 406842a4-90f7-4bc6-bf9c-2215a14e1feb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89832024-12-13T21:09:14.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d6696378-8575-48ca-9bf4-f967f238bf2b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89842024-12-13T21:09:14.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d6696378-8575-48ca-9bf4-f967f238bf2b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89852024-12-13T21:09:14.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d6696378-8575-48ca-9bf4-f967f238bf2b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89862024-12-13T21:09:15.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e2d9e845-2c0f-49b7-ab10-e8deadcbe4e5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89872024-12-13T21:09:15.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e2d9e845-2c0f-49b7-ab10-e8deadcbe4e5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89882024-12-13T21:09:15.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e2d9e845-2c0f-49b7-ab10-e8deadcbe4e5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89892024-12-13T21:09:16.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f51bb0e8-ebd9-4ed0-8b9a-e7df0184d9e8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89902024-12-13T21:09:16.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f51bb0e8-ebd9-4ed0-8b9a-e7df0184d9e8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89912024-12-13T21:09:16.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f51bb0e8-ebd9-4ed0-8b9a-e7df0184d9e8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89922024-12-13T21:09:17.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 314d2b39-fa53-42db-8f17-d35b46f90fba roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89932024-12-13T21:09:17.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 314d2b39-fa53-42db-8f17-d35b46f90fba resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89942024-12-13T21:09:17.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 314d2b39-fa53-42db-8f17-d35b46f90fba response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
89952024-12-13T21:09:17.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1418 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 7664982e-afea-4573-a5ea-1cdad32bc5e7 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
89962024-12-13T21:09:17.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
89972024-12-13T21:09:17.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89982024-12-13T21:09:17.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
89992024-12-13T21:09:17.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90002024-12-13T21:09:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90012024-12-13T21:09:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90022024-12-13T21:09:17.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90032024-12-13T21:09:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90042024-12-13T21:09:17.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90052024-12-13T21:09:17.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.84605ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90062024-12-13T21:09:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90072024-12-13T21:09:17.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90082024-12-13T21:09:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90092024-12-13T21:09:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90102024-12-13T21:09:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90112024-12-13T21:09:17.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90122024-12-13T21:09:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
90132024-12-13T21:09:17.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90142024-12-13T21:09:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90152024-12-13T21:09:17.743ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
90162024-12-13T21:09:17.743ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.743294ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
90172024-12-13T21:09:18.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 51bae8fd-7c48-4eac-afe6-529acd88eafd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90182024-12-13T21:09:18.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 51bae8fd-7c48-4eac-afe6-529acd88eafd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90192024-12-13T21:09:18.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 51bae8fd-7c48-4eac-afe6-529acd88eafd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90202024-12-13T21:09:19.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8c23b391-8014-412d-bf1b-04b0f030f640 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90212024-12-13T21:09:19.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8c23b391-8014-412d-bf1b-04b0f030f640 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90222024-12-13T21:09:19.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8c23b391-8014-412d-bf1b-04b0f030f640 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90232024-12-13T21:09:20.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ba6976ca-44b7-4bb3-86ac-22ac8172a05c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90242024-12-13T21:09:20.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ba6976ca-44b7-4bb3-86ac-22ac8172a05c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90252024-12-13T21:09:20.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ba6976ca-44b7-4bb3-86ac-22ac8172a05c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90262024-12-13T21:09:21.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c373f77-d947-409f-8c9a-321aaef3bde7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90272024-12-13T21:09:21.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c373f77-d947-409f-8c9a-321aaef3bde7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90282024-12-13T21:09:21.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c373f77-d947-409f-8c9a-321aaef3bde7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90292024-12-13T21:09:22.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 40d9e38f-c2b8-49ff-8f93-1bb58186ef40 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90302024-12-13T21:09:22.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 40d9e38f-c2b8-49ff-8f93-1bb58186ef40 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90312024-12-13T21:09:22.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 40d9e38f-c2b8-49ff-8f93-1bb58186ef40 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90322024-12-13T21:09:23.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b103807a-4c29-4d36-b397-80109efb10c5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90332024-12-13T21:09:23.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b103807a-4c29-4d36-b397-80109efb10c5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90342024-12-13T21:09:23.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b103807a-4c29-4d36-b397-80109efb10c5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90352024-12-13T21:09:24.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 571d4fa0-f839-4924-90d8-d27b5ef7074f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90362024-12-13T21:09:24.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 571d4fa0-f839-4924-90d8-d27b5ef7074f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90372024-12-13T21:09:24.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 571d4fa0-f839-4924-90d8-d27b5ef7074f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90382024-12-13T21:09:25.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f6841c0-b18d-4a2c-ac2f-4912e296d83b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90392024-12-13T21:09:25.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f6841c0-b18d-4a2c-ac2f-4912e296d83b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90402024-12-13T21:09:25.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f6841c0-b18d-4a2c-ac2f-4912e296d83b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90412024-12-13T21:09:26.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 67d6941a-9725-4734-8ada-e52210972e08 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
90422024-12-13T21:09:26.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 67d6941a-9725-4734-8ada-e52210972e08 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
90432024-12-13T21:09:26.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 67d6941a-9725-4734-8ada-e52210972e08 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
90442024-12-13T21:09:26.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = d3f5f570-e366-498e-b845-2d04a096bcdb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
90452024-12-13T21:09:26.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = d3f5f570-e366-498e-b845-2d04a096bcdb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
90462024-12-13T21:09:26.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = d3f5f570-e366-498e-b845-2d04a096bcdb response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
90472024-12-13T21:09:26.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa8e0ada-2325-49b2-bd8d-748ae95f43d7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90482024-12-13T21:09:26.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa8e0ada-2325-49b2-bd8d-748ae95f43d7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90492024-12-13T21:09:26.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa8e0ada-2325-49b2-bd8d-748ae95f43d7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90502024-12-13T21:09:27.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 12aa6ac4-f77b-4676-bbdf-9eba9e2b2d52 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
90512024-12-13T21:09:27.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
90522024-12-13T21:09:27.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
90532024-12-13T21:09:27.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90542024-12-13T21:09:27.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90552024-12-13T21:09:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90562024-12-13T21:09:27.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90572024-12-13T21:09:27.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90582024-12-13T21:09:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90592024-12-13T21:09:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90602024-12-13T21:09:27.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90612024-12-13T21:09:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90622024-12-13T21:09:27.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90632024-12-13T21:09:27.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90642024-12-13T21:09:27.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90652024-12-13T21:09:27.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90662024-12-13T21:09:27.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
90672024-12-13T21:09:27.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90682024-12-13T21:09:27.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90692024-12-13T21:09:27.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
90702024-12-13T21:09:27.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.471112ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
90712024-12-13T21:09:27.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.880874ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90722024-12-13T21:09:27.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f83720f8-7b39-4fc8-aa06-825d668baaf0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90732024-12-13T21:09:27.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f83720f8-7b39-4fc8-aa06-825d668baaf0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90742024-12-13T21:09:27.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f83720f8-7b39-4fc8-aa06-825d668baaf0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90752024-12-13T21:09:28.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d3cfb68a-abad-43c9-b94a-bbf9204b22cd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90762024-12-13T21:09:28.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d3cfb68a-abad-43c9-b94a-bbf9204b22cd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90772024-12-13T21:09:28.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d3cfb68a-abad-43c9-b94a-bbf9204b22cd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90782024-12-13T21:09:29.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ea1e9465-1e8d-4f50-b3da-553691eac017 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90792024-12-13T21:09:29.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ea1e9465-1e8d-4f50-b3da-553691eac017 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90802024-12-13T21:09:29.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ea1e9465-1e8d-4f50-b3da-553691eac017 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90812024-12-13T21:09:30.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e92920a2-9c92-470e-894a-d94be5690c87 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90822024-12-13T21:09:30.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e92920a2-9c92-470e-894a-d94be5690c87 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90832024-12-13T21:09:30.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e92920a2-9c92-470e-894a-d94be5690c87 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90842024-12-13T21:09:31.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = be440ab2-689e-4a0c-a370-cf1e66c2095e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90852024-12-13T21:09:31.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = be440ab2-689e-4a0c-a370-cf1e66c2095e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90862024-12-13T21:09:31.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = be440ab2-689e-4a0c-a370-cf1e66c2095e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90872024-12-13T21:09:32.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 0bdbeb9b-6049-4535-a3a5-656ad125ec5a roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
90882024-12-13T21:09:32.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 0bdbeb9b-6049-4535-a3a5-656ad125ec5a resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
90892024-12-13T21:09:32.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 0bdbeb9b-6049-4535-a3a5-656ad125ec5a response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
90902024-12-13T21:09:32.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 9d9ec992-e769-46a6-8380-7acfcda9039b roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
90912024-12-13T21:09:32.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 9d9ec992-e769-46a6-8380-7acfcda9039b resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
90922024-12-13T21:09:32.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 9d9ec992-e769-46a6-8380-7acfcda9039b response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
90932024-12-13T21:09:32.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d19b419-7887-4b36-8e91-2d10207685ca roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90942024-12-13T21:09:32.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d19b419-7887-4b36-8e91-2d10207685ca resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90952024-12-13T21:09:32.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d19b419-7887-4b36-8e91-2d10207685ca response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90962024-12-13T21:09:33.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d483980-8053-437a-98f5-56b3042a23cf roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90972024-12-13T21:09:33.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d483980-8053-437a-98f5-56b3042a23cf resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90982024-12-13T21:09:33.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9d483980-8053-437a-98f5-56b3042a23cf response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
90992024-12-13T21:09:34.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0b89ccc7-5ef3-4c9a-9127-be9937e8a541 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91002024-12-13T21:09:34.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0b89ccc7-5ef3-4c9a-9127-be9937e8a541 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91012024-12-13T21:09:34.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0b89ccc7-5ef3-4c9a-9127-be9937e8a541 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91022024-12-13T21:09:34.966ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49357
91032024-12-13T21:09:34.970ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82f29125-113c-461a-9a89-32612a111b25 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-13T21:09:34.958367266Z }
91042024-12-13T21:09:34.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82f29125-113c-461a-9a89-32612a111b25 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
91052024-12-13T21:09:34.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82f29125-113c-461a-9a89-32612a111b25 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
91062024-12-13T21:09:34.993ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:33125
91072024-12-13T21:09:34.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33125 req_id = 1279fa39-262e-457f-a442-c27418ad88b3 roles = RoleSet { roles: {} } uri = /metrics/producers
91082024-12-13T21:09:34.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33125 req_id = 1279fa39-262e-457f-a442-c27418ad88b3 resource = Database result = Ok(()) uri = /metrics/producers
91092024-12-13T21:09:35.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37988 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 82f29125-113c-461a-9a89-32612a111b25 response_code = 204 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
91102024-12-13T21:09:35.006ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a84796e-aa79-401f-968b-e7e8b47d730b uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-13T21:09:35.006691259Z }
91112024-12-13T21:09:35.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a84796e-aa79-401f-968b-e7e8b47d730b roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
91122024-12-13T21:09:35.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a84796e-aa79-401f-968b-e7e8b47d730b resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
91132024-12-13T21:09:35.032ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b
91142024-12-13T21:09:35.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38236 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33125 req_id = 1279fa39-262e-457f-a442-c27418ad88b3 response_code = 201 uri = /metrics/producers
91152024-12-13T21:09:35.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34273 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8a84796e-aa79-401f-968b-e7e8b47d730b response_code = 204 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
91162024-12-13T21:09:35.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b908d26e-a08b-4722-9aff-b0912b6720a7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91172024-12-13T21:09:35.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b908d26e-a08b-4722-9aff-b0912b6720a7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91182024-12-13T21:09:35.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b908d26e-a08b-4722-9aff-b0912b6720a7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91192024-12-13T21:09:37.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b8a6a208-5251-4328-ab06-6ccce8345ec1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91202024-12-13T21:09:37.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b8a6a208-5251-4328-ab06-6ccce8345ec1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91212024-12-13T21:09:37.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b8a6a208-5251-4328-ab06-6ccce8345ec1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
91222024-12-13T21:09:37.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1271 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 3e905064-aff8-4d8b-af67-6242409b11f4 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
91232024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
91242024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91252024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
91262024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
91272024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91282024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
91292024-12-13T21:09:37.721ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
91302024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91312024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
91322024-12-13T21:09:37.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91332024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
91342024-12-13T21:09:37.722ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
91352024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
91362024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
91372024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.6\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
91382024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
91392024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91402024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
91412024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91422024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
91432024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
91442024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
91452024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91462024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
91472024-12-13T21:09:37.722ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 20:59:37.722011589 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
91482024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
91492024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
91502024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
91512024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91522024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91532024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
91542024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91552024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
91562024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
91572024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91582024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
91592024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
91602024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91612024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
91622024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91632024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91642024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
91652024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91662024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
91672024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91682024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
91692024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91702024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
91712024-12-13T21:09:37.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91722024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91732024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
91742024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91752024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91762024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91772024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91782024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91792024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91802024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
91812024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91822024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91832024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91842024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91852024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91862024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91872024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91882024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91892024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
91902024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91912024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91922024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91932024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91942024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91952024-12-13T21:09:37.722ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 237811962 } })
91962024-12-13T21:09:37.722ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 237861373 } })
91972024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
91982024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91992024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
92002024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
92012024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
92022024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
92032024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92042024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92052024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92062024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
92072024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92082024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92092024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92102024-12-13T21:09:37.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92112024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92122024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92132024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92142024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92152024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92162024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
92172024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.330385ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
92182024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92192024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92202024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92212024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
92222024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.293533ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
92232024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92242024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92252024-12-13T21:09:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92262024-12-13T21:09:37.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92272024-12-13T21:09:37.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 240468091 } })
92282024-12-13T21:09:37.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92292024-12-13T21:09:37.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92302024-12-13T21:09:37.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92312024-12-13T21:09:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.845849ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92322024-12-13T21:09:37.726ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332024-12-13T21:09:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92342024-12-13T21:09:37.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92352024-12-13T21:09:37.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92362024-12-13T21:09:37.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
92372024-12-13T21:09:37.728ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92382024-12-13T21:09:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92392024-12-13T21:09:37.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92402024-12-13T21:09:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92412024-12-13T21:09:37.730ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 20:59:37.722011589 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
92422024-12-13T21:09:37.730ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.192342ms iteration = 13 status = {"expiration":"2024-12-13T20:59:37.722011589Z","pruned":[]}
92432024-12-13T21:09:37.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92442024-12-13T21:09:37.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92452024-12-13T21:09:37.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92462024-12-13T21:09:37.732ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92472024-12-13T21:09:37.732ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92482024-12-13T21:09:37.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92492024-12-13T21:09:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92502024-12-13T21:09:37.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 247861653 } })
92512024-12-13T21:09:37.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92522024-12-13T21:09:37.733ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92532024-12-13T21:09:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92542024-12-13T21:09:37.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92552024-12-13T21:09:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92562024-12-13T21:09:37.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92572024-12-13T21:09:37.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92582024-12-13T21:09:37.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92592024-12-13T21:09:37.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92602024-12-13T21:09:37.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92612024-12-13T21:09:37.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92622024-12-13T21:09:37.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92632024-12-13T21:09:37.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92642024-12-13T21:09:37.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92652024-12-13T21:09:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92662024-12-13T21:09:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92672024-12-13T21:09:37.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92682024-12-13T21:09:37.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92692024-12-13T21:09:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92702024-12-13T21:09:37.741ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92712024-12-13T21:09:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92722024-12-13T21:09:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92732024-12-13T21:09:37.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92742024-12-13T21:09:37.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92752024-12-13T21:09:37.742ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92762024-12-13T21:09:37.743ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.979114ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
92772024-12-13T21:09:37.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92782024-12-13T21:09:37.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92792024-12-13T21:09:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92802024-12-13T21:09:37.745ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92812024-12-13T21:09:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92822024-12-13T21:09:37.745ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
92832024-12-13T21:09:37.745ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
92842024-12-13T21:09:37.745ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 22.74271ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
92852024-12-13T21:09:37.746ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92862024-12-13T21:09:37.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92872024-12-13T21:09:37.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92882024-12-13T21:09:37.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92892024-12-13T21:09:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92902024-12-13T21:09:37.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92912024-12-13T21:09:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92922024-12-13T21:09:37.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92932024-12-13T21:09:37.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92942024-12-13T21:09:37.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92952024-12-13T21:09:37.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92962024-12-13T21:09:37.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92972024-12-13T21:09:37.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92982024-12-13T21:09:37.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92992024-12-13T21:09:37.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93002024-12-13T21:09:37.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93012024-12-13T21:09:37.758ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93022024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93032024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93042024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93052024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
93062024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
93072024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
93082024-12-13T21:09:37.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93092024-12-13T21:09:37.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93102024-12-13T21:09:37.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93112024-12-13T21:09:37.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93122024-12-13T21:09:37.762ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 277602444 } })
93132024-12-13T21:09:37.764ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
93142024-12-13T21:09:37.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 41.983569ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93152024-12-13T21:09:37.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93162024-12-13T21:09:37.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93172024-12-13T21:09:37.767ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93182024-12-13T21:09:37.769ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93192024-12-13T21:09:37.769ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93202024-12-13T21:09:37.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 47.211354ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93212024-12-13T21:09:37.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93222024-12-13T21:09:37.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93232024-12-13T21:09:37.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93242024-12-13T21:09:37.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93252024-12-13T21:09:37.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93262024-12-13T21:09:37.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93272024-12-13T21:09:37.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.759438ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93282024-12-13T21:09:37.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93292024-12-13T21:09:37.775ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93302024-12-13T21:09:37.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93312024-12-13T21:09:37.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93322024-12-13T21:09:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93332024-12-13T21:09:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93342024-12-13T21:09:37.777ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93352024-12-13T21:09:37.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93362024-12-13T21:09:37.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93372024-12-13T21:09:37.778ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93382024-12-13T21:09:37.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93392024-12-13T21:09:37.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93402024-12-13T21:09:37.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93412024-12-13T21:09:37.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93422024-12-13T21:09:37.780ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 58.507577ms iteration = 6 status = {"nsuccess":5}
93432024-12-13T21:09:37.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93442024-12-13T21:09:37.781ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93452024-12-13T21:09:37.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93462024-12-13T21:09:37.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93472024-12-13T21:09:37.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93482024-12-13T21:09:37.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93492024-12-13T21:09:37.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
93502024-12-13T21:09:37.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93512024-12-13T21:09:37.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93522024-12-13T21:09:37.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.029591ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
93532024-12-13T21:09:37.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.075814ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
93542024-12-13T21:09:37.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93552024-12-13T21:09:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93562024-12-13T21:09:37.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.009735ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93572024-12-13T21:09:37.792ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
93582024-12-13T21:09:37.792ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
93592024-12-13T21:09:37.792ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
93602024-12-13T21:09:37.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93612024-12-13T21:09:37.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93622024-12-13T21:09:37.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93632024-12-13T21:09:37.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93642024-12-13T21:09:37.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93652024-12-13T21:09:37.794ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
93662024-12-13T21:09:37.794ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
93672024-12-13T21:09:37.794ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.724096ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
93682024-12-13T21:09:37.797ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
93692024-12-13T21:09:37.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.079147ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
93702024-12-13T21:09:37.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93712024-12-13T21:09:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93722024-12-13T21:09:37.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93732024-12-13T21:09:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93742024-12-13T21:09:37.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93752024-12-13T21:09:37.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93762024-12-13T21:09:37.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93772024-12-13T21:09:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93782024-12-13T21:09:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
93792024-12-13T21:09:37.812ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 90.752705ms iteration = 29 status = {"physical_disks_added":0}
93802024-12-13T21:09:37.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93812024-12-13T21:09:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93822024-12-13T21:09:37.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93832024-12-13T21:09:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93842024-12-13T21:09:37.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93852024-12-13T21:09:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93862024-12-13T21:09:37.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93872024-12-13T21:09:37.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
93882024-12-13T21:09:37.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93892024-12-13T21:09:37.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93902024-12-13T21:09:37.839ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
93912024-12-13T21:09:37.839ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 117.091267ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
93922024-12-13T21:09:37.848ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
93932024-12-13T21:09:37.848ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
93942024-12-13T21:09:37.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93952024-12-13T21:09:37.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93962024-12-13T21:09:37.858ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
93972024-12-13T21:09:37.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93982024-12-13T21:09:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93992024-12-13T21:09:37.935ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
94002024-12-13T21:09:37.935ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 212.977305ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
94012024-12-13T21:09:38.026ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94022024-12-13T21:09:38.026ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94032024-12-13T21:09:38.026ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de48124d-f2c5-4b13-bc07-27f5e261a951", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
94042024-12-13T21:09:38.026ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94052024-12-13T21:09:38.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 126bfc27-acd8-4127-bb9c-a53c864696ab roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
94062024-12-13T21:09:38.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 126bfc27-acd8-4127-bb9c-a53c864696ab resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
94072024-12-13T21:09:38.030ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94082024-12-13T21:09:38.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1/state
94092024-12-13T21:09:38.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "bad0079f-7232-46e9-b1b3-83ede20f4e03", "content-length": "130", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
94102024-12-13T21:09:38.038ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 317.058255ms iteration = 25 status = 0
94112024-12-13T21:09:38.038ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b sled_id = 82024834-9725-4304-9edd-af6b519041b3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-13T21:09:35.006691259Z }, migration_in: None, migration_out: None } vmm_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
94122024-12-13T21:09:38.039ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 sled_id = 82024834-9725-4304-9edd-af6b519041b3 vmm_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-13T21:09:35.006691259Z }
94132024-12-13T21:09:38.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b roles = RoleSet { roles: {} } sled_id = 82024834-9725-4304-9edd-af6b519041b3 vmm_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
94142024-12-13T21:09:38.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b resource = Database result = Ok(()) sled_id = 82024834-9725-4304-9edd-af6b519041b3 vmm_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
94152024-12-13T21:09:38.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162024-12-13T21:09:38.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 126bfc27-acd8-4127-bb9c-a53c864696ab response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
94172024-12-13T21:09:38.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94182024-12-13T21:09:38.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94192024-12-13T21:09:38.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94202024-12-13T21:09:38.047ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
94212024-12-13T21:09:38.047ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94222024-12-13T21:09:38.047ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
94232024-12-13T21:09:38.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 325.085482ms iteration = 14 status = {"generation":1}
94242024-12-13T21:09:38.050ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94252024-12-13T21:09:38.051ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d85f2b80-0714-4851-9361-23ce4725a15c", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94262024-12-13T21:09:38.051ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94272024-12-13T21:09:38.054ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "020740b6-d124-4b97-85be-1d84870bd70b", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94282024-12-13T21:09:38.054ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94292024-12-13T21:09:38.056ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94302024-12-13T21:09:38.056ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.032484ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
94312024-12-13T21:09:38.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
94322024-12-13T21:09:38.069ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94332024-12-13T21:09:38.069ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
94342024-12-13T21:09:38.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94352024-12-13T21:09:38.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94362024-12-13T21:09:38.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94372024-12-13T21:09:38.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94382024-12-13T21:09:38.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94392024-12-13T21:09:38.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94402024-12-13T21:09:38.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 353.275993ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94412024-12-13T21:09:38.077ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
94422024-12-13T21:09:38.077ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94432024-12-13T21:09:38.077ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
94442024-12-13T21:09:38.077ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 355.07247ms iteration = 14 status = {"generation":2}
94452024-12-13T21:09:38.084ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94462024-12-13T21:09:38.084ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94472024-12-13T21:09:38.084ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbd77fc2-3c81-4f30-944c-2e6ddb24f6a7", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
94482024-12-13T21:09:38.084ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94492024-12-13T21:09:38.085ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
94502024-12-13T21:09:38.087ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94512024-12-13T21:09:38.088ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 366.773293ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
94522024-12-13T21:09:38.092ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
94532024-12-13T21:09:38.092ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94542024-12-13T21:09:38.092ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e28050b-d32a-4b17-80ea-6619fb0ba8d6", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
94552024-12-13T21:09:38.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94562024-12-13T21:09:38.094ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
94572024-12-13T21:09:38.105ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94582024-12-13T21:09:38.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94592024-12-13T21:09:38.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd29136c-29fc-4461-aedb-be6732bfec49", "content-length": "585", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
94602024-12-13T21:09:38.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94612024-12-13T21:09:38.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94622024-12-13T21:09:38.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94632024-12-13T21:09:38.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94642024-12-13T21:09:38.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94652024-12-13T21:09:38.143ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94662024-12-13T21:09:38.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94672024-12-13T21:09:38.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94682024-12-13T21:09:38.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94692024-12-13T21:09:38.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94702024-12-13T21:09:38.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94712024-12-13T21:09:38.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94722024-12-13T21:09:38.153ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {ecd48fc1-5e50-4826-92c4-4e7aaa10531a: {10.151.2.176: {05f636af-5ff3-4737-a280-0570e025ea69}, 10.151.2.175: {05f636af-5ff3-4737-a280-0570e025ea69}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94732024-12-13T21:09:38.153ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94742024-12-13T21:09:38.153ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "61fdd33d-5b6b-495b-b304-c0573fb8297e", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
94752024-12-13T21:09:38.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94762024-12-13T21:09:38.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94772024-12-13T21:09:38.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94782024-12-13T21:09:38.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94792024-12-13T21:09:38.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94802024-12-13T21:09:38.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94812024-12-13T21:09:38.160ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.169676ms iteration = 25 status = {}
94822024-12-13T21:09:38.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94832024-12-13T21:09:38.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94842024-12-13T21:09:38.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
94852024-12-13T21:09:38.199ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94862024-12-13T21:09:38.199ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "22e939f3-cb4e-4613-93e9-2fcb646c227f", "content-length": "1", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
94872024-12-13T21:09:38.200ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94882024-12-13T21:09:38.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94892024-12-13T21:09:38.250ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94902024-12-13T21:09:38.251ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "860ad2ef-f2a5-443d-91e7-ff24f3967810", "content-length": "811", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
94912024-12-13T21:09:38.251ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(11266431) }} sled = sock
94922024-12-13T21:09:38.251ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
94932024-12-13T21:09:38.251ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
94942024-12-13T21:09:38.252ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.560782ms iteration = 25 status = {}
94952024-12-13T21:09:38.252ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 530.765347ms iteration = 25 status = null
94962024-12-13T21:09:38.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94972024-12-13T21:09:38.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94982024-12-13T21:09:38.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94992024-12-13T21:09:38.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95002024-12-13T21:09:38.263ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95012024-12-13T21:09:38.263ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95022024-12-13T21:09:38.263ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95032024-12-13T21:09:38.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e6a34e88-226b-4cef-9d0e-c021157678c5", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
95042024-12-13T21:09:38.265ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 543.59898ms iteration = 26 status = {}
95052024-12-13T21:09:38.268ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95062024-12-13T21:09:38.269ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4fe1502a-8788-4ea9-9dc5-c5ae6c83beb0", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95072024-12-13T21:09:38.269ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95082024-12-13T21:09:38.271ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cee5e165-7fff-40dc-aed2-d5118ba77c75", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95092024-12-13T21:09:38.271ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95102024-12-13T21:09:38.273ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ae4ed827-cbae-4081-a3fe-3f8c0a0fb1b0", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95112024-12-13T21:09:38.273ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95122024-12-13T21:09:38.275ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95132024-12-13T21:09:38.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.813955ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95142024-12-13T21:09:38.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95152024-12-13T21:09:38.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95162024-12-13T21:09:38.315ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
95172024-12-13T21:09:38.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95182024-12-13T21:09:38.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95192024-12-13T21:09:38.326ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95202024-12-13T21:09:38.326ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "978dcace-1273-402f-adee-7baba2c4a800", "content-length": "134", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
95212024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95222024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
95232024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95242024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95252024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95262024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95272024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95282024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95292024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95302024-12-13T21:09:38.326ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95312024-12-13T21:09:38.327ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
95322024-12-13T21:09:38.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95332024-12-13T21:09:38.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95342024-12-13T21:09:38.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95352024-12-13T21:09:38.329ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9d3e6c5-c727-470b-b75c-5a74902de2fc", "content-length": "2", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
95362024-12-13T21:09:38.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95372024-12-13T21:09:38.329ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8020794e-01fe-4998-ad53-51262f31e64e", "content-length": "52", "date": "Fri, 13 Dec 2024 21:09:37 GMT"} })
95382024-12-13T21:09:38.329ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
95392024-12-13T21:09:38.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95402024-12-13T21:09:38.427ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9e915fa3-150f-49f9-ad86-3635c29b5074", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
95412024-12-13T21:09:38.428ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
95422024-12-13T21:09:38.428ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95432024-12-13T21:09:38.428ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "837b19c3-b9a0-4d1f-bb32-0875ae56c812", "content-length": "682", "date": "Fri, 13 Dec 2024 21:09:38 GMT"} })
95442024-12-13T21:09:38.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95452024-12-13T21:09:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95462024-12-13T21:09:38.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95472024-12-13T21:09:38.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95482024-12-13T21:09:38.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95492024-12-13T21:09:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95502024-12-13T21:09:38.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95512024-12-13T21:09:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95522024-12-13T21:09:38.447ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 725.428086ms iteration = 25 status = {}
95532024-12-13T21:09:39.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb6f7620-0168-4d9d-87b3-d0473ee4ca9f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95542024-12-13T21:09:39.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb6f7620-0168-4d9d-87b3-d0473ee4ca9f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95552024-12-13T21:09:39.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cb6f7620-0168-4d9d-87b3-d0473ee4ca9f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95562024-12-13T21:09:40.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 42059b7d-6ff0-4abf-8c9b-7e073d355c74 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95572024-12-13T21:09:40.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 42059b7d-6ff0-4abf-8c9b-7e073d355c74 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95582024-12-13T21:09:40.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 42059b7d-6ff0-4abf-8c9b-7e073d355c74 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95592024-12-13T21:09:41.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4229b75a-9135-44d3-854a-37afefc3659c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95602024-12-13T21:09:41.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4229b75a-9135-44d3-854a-37afefc3659c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95612024-12-13T21:09:41.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4229b75a-9135-44d3-854a-37afefc3659c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95622024-12-13T21:09:42.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 17955520-54c0-4b1d-be72-dc0295acba79 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95632024-12-13T21:09:42.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 17955520-54c0-4b1d-be72-dc0295acba79 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95642024-12-13T21:09:42.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 17955520-54c0-4b1d-be72-dc0295acba79 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95652024-12-13T21:09:43.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 35c3cb0a-46c7-48ec-b7cd-62c3eefe0cb0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95662024-12-13T21:09:43.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 35c3cb0a-46c7-48ec-b7cd-62c3eefe0cb0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95672024-12-13T21:09:43.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 35c3cb0a-46c7-48ec-b7cd-62c3eefe0cb0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95682024-12-13T21:09:44.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c9c48d0e-0849-4882-9fde-b158db1035a1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95692024-12-13T21:09:44.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c9c48d0e-0849-4882-9fde-b158db1035a1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95702024-12-13T21:09:44.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c9c48d0e-0849-4882-9fde-b158db1035a1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95712024-12-13T21:09:45.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6626b31f-4562-4da5-a894-4e8eb8866289 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95722024-12-13T21:09:45.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6626b31f-4562-4da5-a894-4e8eb8866289 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95732024-12-13T21:09:45.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6626b31f-4562-4da5-a894-4e8eb8866289 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95742024-12-13T21:09:45.462ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5af5d15-f5f1-4702-8e06-64ebcba4438b uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-13T21:09:45.462445167Z }
95752024-12-13T21:09:45.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5af5d15-f5f1-4702-8e06-64ebcba4438b roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
95762024-12-13T21:09:45.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5af5d15-f5f1-4702-8e06-64ebcba4438b resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
95772024-12-13T21:09:45.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14248 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e5af5d15-f5f1-4702-8e06-64ebcba4438b response_code = 204 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
95782024-12-13T21:09:45.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 9dafb8ff-d23a-4103-b3fd-27342a84a111 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
95792024-12-13T21:09:45.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 9dafb8ff-d23a-4103-b3fd-27342a84a111 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
95802024-12-13T21:09:45.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 9dafb8ff-d23a-4103-b3fd-27342a84a111 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
95812024-12-13T21:09:45.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 7e315c3a-d933-41f7-bfb3-40f409876eac roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
95822024-12-13T21:09:45.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 7e315c3a-d933-41f7-bfb3-40f409876eac resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
95832024-12-13T21:09:45.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 7e315c3a-d933-41f7-bfb3-40f409876eac response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
95842024-12-13T21:09:46.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0c56988a-cbc4-4041-b445-1f33f4d14602 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95852024-12-13T21:09:46.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0c56988a-cbc4-4041-b445-1f33f4d14602 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95862024-12-13T21:09:46.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0c56988a-cbc4-4041-b445-1f33f4d14602 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95872024-12-13T21:09:47.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = abddee6d-4976-451a-91ff-2924124152d2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95882024-12-13T21:09:47.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = abddee6d-4976-451a-91ff-2924124152d2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95892024-12-13T21:09:47.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = abddee6d-4976-451a-91ff-2924124152d2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
95902024-12-13T21:09:47.666ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3868 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e3c9def4-a871-4558-b830-24e1cd45c605 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
95912024-12-13T21:09:47.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
95922024-12-13T21:09:47.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95932024-12-13T21:09:47.721ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
95942024-12-13T21:09:47.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95952024-12-13T21:09:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95962024-12-13T21:09:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95972024-12-13T21:09:47.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95982024-12-13T21:09:47.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95992024-12-13T21:09:47.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96002024-12-13T21:09:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96012024-12-13T21:09:47.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96022024-12-13T21:09:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96032024-12-13T21:09:47.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96042024-12-13T21:09:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96052024-12-13T21:09:47.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96062024-12-13T21:09:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
96072024-12-13T21:09:47.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96082024-12-13T21:09:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96092024-12-13T21:09:47.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
96102024-12-13T21:09:47.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.207497ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
96112024-12-13T21:09:47.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.258616ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96122024-12-13T21:09:47.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = b585b115-1121-4a3a-87be-1e9106e42f27 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
96132024-12-13T21:09:47.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = b585b115-1121-4a3a-87be-1e9106e42f27 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
96142024-12-13T21:09:47.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = b585b115-1121-4a3a-87be-1e9106e42f27 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
96152024-12-13T21:09:47.910ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-13T21:09:47.909824738Z }
96162024-12-13T21:09:47.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96172024-12-13T21:09:47.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96182024-12-13T21:09:47.945ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_needs_update = true
96192024-12-13T21:09:47.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96202024-12-13T21:09:47.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96212024-12-13T21:09:47.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96222024-12-13T21:09:47.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96232024-12-13T21:09:47.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96242024-12-13T21:09:47.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96252024-12-13T21:09:47.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96262024-12-13T21:09:47.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96272024-12-13T21:09:47.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96282024-12-13T21:09:47.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96292024-12-13T21:09:47.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96302024-12-13T21:09:47.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96312024-12-13T21:09:47.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96322024-12-13T21:09:47.960ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9b17a900-d817-4355-ae3b-0335ac1f374b, lookup_type: ById(9b17a900-d817-4355-ae3b-0335ac1f374b) }, key: 1d08af0a-85fa-424d-9364-5693e4324c13, lookup_type: ById(1d08af0a-85fa-424d-9364-5693e4324c13) }, key: c93a3eee-a350-4ad6-bb82-c9b2c48bb60b, lookup_type: ById(c93a3eee-a350-4ad6-bb82-c9b2c48bb60b) } result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96332024-12-13T21:09:47.960ZINFOnexus (dropshot_internal): starting update saga for c93a3eee-a350-4ad6-bb82-c9b2c48bb60b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-13T21:09:47.909824738Z }
96342024-12-13T21:09:47.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50929 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 response_code = 204 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96352024-12-13T21:09:47.961ZDEBGnexus (dropshot_internal): preparing instance-update saga for c93a3eee-a350-4ad6-bb82-c9b2c48bb60b... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1c16c9ec-2b25-4933-bb3d-e83c2cb6a8b3 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96362024-12-13T21:09:47.961ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update
96372024-12-13T21:09:47.961ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"c93a3eee-a350-4ad6-bb82-c9b2c48bb60b","lookup_type":{"ById":"c93a3eee-a350-4ad6-bb82-c9b2c48bb60b"},"parent":{"key":"1d08af0a-85fa-424d-9364-5693e4324c13","lookup_type":{"ById":"1d08af0a-85fa-424d-9364-5693e4324c13"},"parent":{"key":"9b17a900-d817-4355-ae3b-0335ac1f374b","lookup_type":{"ById":"9b17a900-d817-4355-ae3b-0335ac1f374b"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96382024-12-13T21:09:47.961ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update
96392024-12-13T21:09:47.961ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ee12a5ea-4854-4a38-b0d4-22383ba4e694 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-13T21:09:47.909824738Z }
96402024-12-13T21:09:47.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ee12a5ea-4854-4a38-b0d4-22383ba4e694 roles = RoleSet { roles: {} } uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96412024-12-13T21:09:47.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ee12a5ea-4854-4a38-b0d4-22383ba4e694 resource = Database result = Ok(()) uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96422024-12-13T21:09:47.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6529 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ee12a5ea-4854-4a38-b0d4-22383ba4e694 response_code = 204 uri = /vmms/fef6555d-7d4b-4b3b-82ad-93b6833ea4d1
96432024-12-13T21:09:47.991ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update
96442024-12-13T21:09:47.991ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96452024-12-13T21:09:47.991ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96462024-12-13T21:09:47.991ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96472024-12-13T21:09:47.995ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96482024-12-13T21:09:47.995ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96492024-12-13T21:09:47.999ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96502024-12-13T21:09:47.999ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96512024-12-13T21:09:48.002ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96522024-12-13T21:09:48.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ac222143-3d66-4e88-a58e-eeb0540d8e46")) node_id = 0 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96532024-12-13T21:09:48.006ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96542024-12-13T21:09:48.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96552024-12-13T21:09:48.012ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update
96562024-12-13T21:09:48.012ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96572024-12-13T21:09:48.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96582024-12-13T21:09:48.014ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96592024-12-13T21:09:48.014ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96602024-12-13T21:09:48.016ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96612024-12-13T21:09:48.016ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96622024-12-13T21:09:48.017ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96632024-12-13T21:09:48.018ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96642024-12-13T21:09:48.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96652024-12-13T21:09:48.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96662024-12-13T21:09:48.020ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96672024-12-13T21:09:48.020ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96682024-12-13T21:09:48.022ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96692024-12-13T21:09:48.025ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9b17a900-d817-4355-ae3b-0335ac1f374b, lookup_type: ById(9b17a900-d817-4355-ae3b-0335ac1f374b) }, key: 1d08af0a-85fa-424d-9364-5693e4324c13, lookup_type: ById(1d08af0a-85fa-424d-9364-5693e4324c13) }, key: c93a3eee-a350-4ad6-bb82-c9b2c48bb60b, lookup_type: ById(c93a3eee-a350-4ad6-bb82-c9b2c48bb60b) } result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96702024-12-13T21:09:48.025ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance updater_id = ac222143-3d66-4e88-a58e-eeb0540d8e46
96712024-12-13T21:09:48.025ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96722024-12-13T21:09:48.025ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96732024-12-13T21:09:48.035ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance updater_id = ac222143-3d66-4e88-a58e-eeb0540d8e46
96742024-12-13T21:09:48.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96752024-12-13T21:09:48.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance
96762024-12-13T21:09:48.039ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b locked_gen = Generation(Generation(2)) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = LockInstance updater_id = ac222143-3d66-4e88-a58e-eeb0540d8e46
96772024-12-13T21:09:48.042ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96782024-12-13T21:09:48.042ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ac222143-3d66-4e88-a58e-eeb0540d8e46")}) node_id = 1 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96792024-12-13T21:09:48.045ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96802024-12-13T21:09:48.045ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
96812024-12-13T21:09:48.052ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96822024-12-13T21:09:48.052ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96832024-12-13T21:09:48.054ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96842024-12-13T21:09:48.054ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96852024-12-13T21:09:48.055ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96862024-12-13T21:09:48.055ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96872024-12-13T21:09:48.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96882024-12-13T21:09:48.059ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9b17a900-d817-4355-ae3b-0335ac1f374b, lookup_type: ById(9b17a900-d817-4355-ae3b-0335ac1f374b) }, key: 1d08af0a-85fa-424d-9364-5693e4324c13, lookup_type: ById(1d08af0a-85fa-424d-9364-5693e4324c13) }, key: c93a3eee-a350-4ad6-bb82-c9b2c48bb60b, lookup_type: ById(c93a3eee-a350-4ad6-bb82-c9b2c48bb60b) } result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96892024-12-13T21:09:48.059ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96902024-12-13T21:09:48.059ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96912024-12-13T21:09:48.067ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: fef6555d-7d4b-4b3b-82ad-93b6833ea4d1, time_created: 2024-12-13T21:09:26.460986Z, time_deleted: None, instance_id: c93a3eee-a350-4ad6-bb82-c9b2c48bb60b, sled_id: 82024834-9725-4304-9edd-af6b519041b3, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-13T21:09:47.909824Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-13T21:09:24.134170Z, gen: Generation(Generation(3)), propolis_id: Some(fef6555d-7d4b-4b3b-82ad-93b6833ea4d1), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-13T21:09:48.065107286Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
96922024-12-13T21:09:48.067ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
96932024-12-13T21:09:48.071ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"c93a3eee-a350-4ad6-bb82-c9b2c48bb60b","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"fef6555d-7d4b-4b3b-82ad-93b6833ea4d1"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"c93a3eee-a350-4ad6-bb82-c9b2c48bb60b","lookup_type":{"ById":"c93a3eee-a350-4ad6-bb82-c9b2c48bb60b"},"parent":{"key":"1d08af0a-85fa-424d-9364-5693e4324c13","lookup_type":{"ById":"1d08af0a-85fa-424d-9364-5693e4324c13"},"parent":{"key":"9b17a900-d817-4355-ae3b-0335ac1f374b","lookup_type":{"ById":"9b17a900-d817-4355-ae3b-0335ac1f374b"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"ac222143-3d66-4e88-a58e-eeb0540d8e46"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"1d08af0a-85fa-424d-9364-5693e4324c13","ram_diff":1073741824},"destroy_active_vmm":"fef6555d-7d4b-4b3b-82ad-93b6833ea4d1","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-13T21:09:48.065107286Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96942024-12-13T21:09:48.071ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
96952024-12-13T21:09:48.100ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
96962024-12-13T21:09:48.100ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96972024-12-13T21:09:48.100ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
96982024-12-13T21:09:48.100ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
96992024-12-13T21:09:48.103ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97002024-12-13T21:09:48.103ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97012024-12-13T21:09:48.107ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97022024-12-13T21:09:48.107ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97032024-12-13T21:09:48.111ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97042024-12-13T21:09:48.111ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("422d514d-8051-4493-bced-27df68cb6b18")) node_id = 0 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97052024-12-13T21:09:48.114ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97062024-12-13T21:09:48.114ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97072024-12-13T21:09:48.120ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b parent_lock = UpdaterLock { updater_id: ac222143-3d66-4e88-a58e-eeb0540d8e46, locked_gen: Generation(Generation(2)) } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97082024-12-13T21:09:48.120ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = BecomeUpdater
97092024-12-13T21:09:48.120ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = BecomeUpdater
97102024-12-13T21:09:48.128ZDEBGnexus (SagaExecutor): inherited lock from ac222143-3d66-4e88-a58e-eeb0540d8e46 to 422d514d-8051-4493-bced-27df68cb6b18 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = ac222143-3d66-4e88-a58e-eeb0540d8e46 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = BecomeUpdater updater_id = 422d514d-8051-4493-bced-27df68cb6b18
97112024-12-13T21:09:48.128ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97122024-12-13T21:09:48.128ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97132024-12-13T21:09:48.128ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("422d514d-8051-4493-bced-27df68cb6b18")}) node_id = 1 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97142024-12-13T21:09:48.132ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97152024-12-13T21:09:48.132ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97162024-12-13T21:09:48.135ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97172024-12-13T21:09:48.135ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97182024-12-13T21:09:48.138ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97192024-12-13T21:09:48.139ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97202024-12-13T21:09:48.144ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97212024-12-13T21:09:48.147ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b
97222024-12-13T21:09:48.149ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UpdateNetworkConfig
97232024-12-13T21:09:48.150ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UpdateNetworkConfig
97242024-12-13T21:09:48.156ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UpdateNetworkConfig
97252024-12-13T21:09:48.156ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UpdateNetworkConfig
97262024-12-13T21:09:48.160ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
97272024-12-13T21:09:48.160ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UpdateNetworkConfig
97282024-12-13T21:09:48.161ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UpdateNetworkConfig
97292024-12-13T21:09:48.163ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
97302024-12-13T21:09:48.163ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
97312024-12-13T21:09:48.163ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
97322024-12-13T21:09:48.165ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
97332024-12-13T21:09:48.166ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
97342024-12-13T21:09:48.166ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
97352024-12-13T21:09:48.166ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
97362024-12-13T21:09:48.170ZDEBGnexus: notifying dendrite of updates instance_id = Some(c93a3eee-a350-4ad6-bb82-c9b2c48bb60b (instance)) switch = switch0
97372024-12-13T21:09:48.170ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1629, tv_nsec: 685961212 } })
97382024-12-13T21:09:48.171ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
97392024-12-13T21:09:48.201ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97402024-12-13T21:09:48.201ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97412024-12-13T21:09:48.202ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0ac7bc6-6195-4701-a3c2-108d14d1d826", "content-length": "26", "date": "Fri, 13 Dec 2024 21:09:47 GMT"} })
97422024-12-13T21:09:48.202ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97432024-12-13T21:09:48.202ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97442024-12-13T21:09:48.232ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
97452024-12-13T21:09:48.232ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc15fda6-7115-4b82-ac61-17c10bcbf525", "content-length": "4", "date": "Fri, 13 Dec 2024 21:09:47 GMT"} })
97462024-12-13T21:09:48.233ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97472024-12-13T21:09:48.233ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97482024-12-13T21:09:48.238ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97492024-12-13T21:09:48.238ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97502024-12-13T21:09:48.241ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
97512024-12-13T21:09:48.242ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
97522024-12-13T21:09:48.259ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-13T21:09:48.245427Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 1d08af0a-85fa-424d-9364-5693e4324c13, time_modified: Some(2024-12-13T21:09:48.245427Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, time_modified: Some(2024-12-13T21:09:48.245427Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97532024-12-13T21:09:48.259ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97542024-12-13T21:09:48.259ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97552024-12-13T21:09:48.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6d747c95-98b7-49ce-b2a9-79190bee3f47 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
97562024-12-13T21:09:48.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6d747c95-98b7-49ce-b2a9-79190bee3f47 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
97572024-12-13T21:09:48.264ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97582024-12-13T21:09:48.264ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97592024-12-13T21:09:48.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6d747c95-98b7-49ce-b2a9-79190bee3f47 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
97602024-12-13T21:09:48.267ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97612024-12-13T21:09:48.267ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UnassignOximeterProducer
97622024-12-13T21:09:48.268ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UnassignOximeterProducer
97632024-12-13T21:09:48.273ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 producer_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97642024-12-13T21:09:48.273ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UnassignOximeterProducer
97652024-12-13T21:09:48.273ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = UnassignOximeterProducer
97662024-12-13T21:09:48.311ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97672024-12-13T21:09:48.313ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/c93a3eee-a350-4ad6-bb82-c9b2c48bb60b
97682024-12-13T21:09:48.323ZDEBGnexus (SagaExecutor): client response oximeter-collector = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/c93a3eee-a350-4ad6-bb82-c9b2c48bb60b", status: 204, headers: {"x-request-id": "da498518-6a73-4521-9bcb-28061e449749", "date": "Fri, 13 Dec 2024 21:09:48 GMT"} }) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97692024-12-13T21:09:48.323ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 producer_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97702024-12-13T21:09:48.324ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97712024-12-13T21:09:48.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97722024-12-13T21:09:48.328ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97732024-12-13T21:09:48.328ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97742024-12-13T21:09:48.331ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b lock = UpdaterLock { updater_id: 422d514d-8051-4493-bced-27df68cb6b18, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-13T21:09:48.065107286Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97752024-12-13T21:09:48.331ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = CommitInstanceUpdates
97762024-12-13T21:09:48.332ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = CommitInstanceUpdates
97772024-12-13T21:09:48.367ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b new_runtime = InstanceRuntimeState { time_updated: 2024-12-13T21:09:48.065107286Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
97782024-12-13T21:09:48.367ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97792024-12-13T21:09:48.367ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97802024-12-13T21:09:48.367ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
97812024-12-13T21:09:48.367ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
97822024-12-13T21:09:48.367ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97832024-12-13T21:09:48.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97842024-12-13T21:09:48.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97852024-12-13T21:09:48.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97862024-12-13T21:09:48.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97872024-12-13T21:09:48.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882024-12-13T21:09:48.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97892024-12-13T21:09:48.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97902024-12-13T21:09:48.371ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97912024-12-13T21:09:48.371ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97922024-12-13T21:09:48.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97932024-12-13T21:09:48.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97942024-12-13T21:09:48.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97952024-12-13T21:09:48.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97962024-12-13T21:09:48.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97972024-12-13T21:09:48.375ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
97982024-12-13T21:09:48.375ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("c93a3eee-a350-4ad6-bb82-c9b2c48bb60b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("fef6555d-7d4b-4b3b-82ad-93b6833ea4d1")}) node_id = 7 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
97992024-12-13T21:09:48.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98002024-12-13T21:09:48.380ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98012024-12-13T21:09:48.380ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98022024-12-13T21:09:48.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98032024-12-13T21:09:48.384ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98042024-12-13T21:09:48.384ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98052024-12-13T21:09:48.387ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98062024-12-13T21:09:48.387ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98072024-12-13T21:09:48.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98082024-12-13T21:09:48.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98092024-12-13T21:09:48.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98102024-12-13T21:09:48.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98112024-12-13T21:09:48.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98122024-12-13T21:09:48.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98132024-12-13T21:09:48.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98142024-12-13T21:09:48.394ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
98152024-12-13T21:09:48.394ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ReleaseSledResources
98162024-12-13T21:09:48.394ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ReleaseSledResources
98172024-12-13T21:09:48.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98182024-12-13T21:09:48.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98192024-12-13T21:09:48.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98202024-12-13T21:09:48.405ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98212024-12-13T21:09:48.405ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98222024-12-13T21:09:48.408ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98232024-12-13T21:09:48.408ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98242024-12-13T21:09:48.412ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b propolis_id = fef6555d-7d4b-4b3b-82ad-93b6833ea4d1 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
98252024-12-13T21:09:48.412ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = MarkVmmDeleted
98262024-12-13T21:09:48.412ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = MarkVmmDeleted
98272024-12-13T21:09:48.420ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98282024-12-13T21:09:48.420ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98292024-12-13T21:09:48.424ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98302024-12-13T21:09:48.424ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98312024-12-13T21:09:48.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98322024-12-13T21:09:48.428ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d002383-b84e-4179-9e18-cf8c703199b7", "content-length": "691", "date": "Fri, 13 Dec 2024 21:09:47 GMT"} })
98332024-12-13T21:09:48.428ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98342024-12-13T21:09:48.428ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98352024-12-13T21:09:48.428ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98362024-12-13T21:09:48.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 62.81213ms iteration = 26 status = {}
98372024-12-13T21:09:48.431ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98382024-12-13T21:09:48.431ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98392024-12-13T21:09:48.463ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98402024-12-13T21:09:48.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98412024-12-13T21:09:48.463ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "269a7b8c-1972-439f-991c-a2708ac31923", "content-length": "372", "date": "Fri, 13 Dec 2024 21:09:47 GMT"} })
98422024-12-13T21:09:48.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98432024-12-13T21:09:48.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98442024-12-13T21:09:48.469ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98452024-12-13T21:09:48.469ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98462024-12-13T21:09:48.472ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98472024-12-13T21:09:48.473ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98482024-12-13T21:09:48.474ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98492024-12-13T21:09:48.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98502024-12-13T21:09:48.476ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98512024-12-13T21:09:48.476ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98522024-12-13T21:09:48.477ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98532024-12-13T21:09:48.480ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9b17a900-d817-4355-ae3b-0335ac1f374b, lookup_type: ById(9b17a900-d817-4355-ae3b-0335ac1f374b) }, key: 1d08af0a-85fa-424d-9364-5693e4324c13, lookup_type: ById(1d08af0a-85fa-424d-9364-5693e4324c13) }, key: c93a3eee-a350-4ad6-bb82-c9b2c48bb60b, lookup_type: ById(c93a3eee-a350-4ad6-bb82-c9b2c48bb60b) } result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98542024-12-13T21:09:48.480ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98552024-12-13T21:09:48.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_node = ChainSuccessorSaga
98562024-12-13T21:09:48.486ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update
98572024-12-13T21:09:48.486ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98582024-12-13T21:09:48.486ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98592024-12-13T21:09:48.486ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
98602024-12-13T21:09:48.486ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
98612024-12-13T21:09:48.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98622024-12-13T21:09:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98632024-12-13T21:09:48.489ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98642024-12-13T21:09:48.489ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98652024-12-13T21:09:48.489ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98662024-12-13T21:09:48.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98672024-12-13T21:09:48.490ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98682024-12-13T21:09:48.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98692024-12-13T21:09:48.494ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98702024-12-13T21:09:48.494ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98712024-12-13T21:09:48.497ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98722024-12-13T21:09:48.497ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4
98732024-12-13T21:09:48.505ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98742024-12-13T21:09:48.505ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 saga_name = instance-update saga_result = SagaResult { saga_id: 53b98901-5f32-4195-88d5-2f846782c5f4, saga_log: SagaLog { saga_id: 53b98901-5f32-4195-88d5-2f846782c5f4, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("422d514d-8051-4493-bced-27df68cb6b18")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("422d514d-8051-4493-bced-27df68cb6b18")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("c93a3eee-a350-4ad6-bb82-c9b2c48bb60b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("fef6555d-7d4b-4b3b-82ad-93b6833ea4d1")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("c93a3eee-a350-4ad6-bb82-c9b2c48bb60b"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("fef6555d-7d4b-4b3b-82ad-93b6833ea4d1")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("422d514d-8051-4493-bced-27df68cb6b18"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("422d514d-8051-4493-bced-27df68cb6b18")}} }) }
98752024-12-13T21:09:48.505ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 53b98901-5f32-4195-88d5-2f846782c5f4 instance_id = c93a3eee-a350-4ad6-bb82-c9b2c48bb60b saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update
98762024-12-13T21:09:48.505ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98772024-12-13T21:09:48.505ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
98782024-12-13T21:09:48.505ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98792024-12-13T21:09:48.505ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98802024-12-13T21:09:48.505ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ea8934ba-fe77-4b83-8ff2-b888216d8659", "date": "Fri, 13 Dec 2024 21:09:47 GMT"} })
98812024-12-13T21:09:48.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98822024-12-13T21:09:48.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98832024-12-13T21:09:48.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98842024-12-13T21:09:48.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98852024-12-13T21:09:48.509ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98862024-12-13T21:09:48.509ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
98872024-12-13T21:09:48.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98882024-12-13T21:09:48.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98892024-12-13T21:09:48.513ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98902024-12-13T21:09:48.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98912024-12-13T21:09:48.514ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "194f1c5c-c731-47a8-84a2-c5c4ca0f24ce", "date": "Fri, 13 Dec 2024 21:09:48 GMT"} })
98922024-12-13T21:09:48.518ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98932024-12-13T21:09:48.518ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
98942024-12-13T21:09:48.521ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 154.203769ms iteration = 27 status = {}
98952024-12-13T21:09:48.526ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
98962024-12-13T21:09:48.526ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5
98972024-12-13T21:09:48.530ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98982024-12-13T21:09:48.530ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98992024-12-13T21:09:48.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99002024-12-13T21:09:48.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99012024-12-13T21:09:48.569ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99022024-12-13T21:09:48.569ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99032024-12-13T21:09:48.569ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.240199ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99042024-12-13T21:09:48.573ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update sec_id = 0599e804-8800-4951-9d87-7a8a49a507a3
99052024-12-13T21:09:48.573ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 37b7af19-80ab-4cf0-a4af-c3534b7087d5 saga_name = start-instance-update saga_result = SagaResult { saga_id: 37b7af19-80ab-4cf0-a4af-c3534b7087d5, saga_log: SagaLog { saga_id: 37b7af19-80ab-4cf0-a4af-c3534b7087d5, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("ac222143-3d66-4e88-a58e-eeb0540d8e46")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ac222143-3d66-4e88-a58e-eeb0540d8e46")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("ac222143-3d66-4e88-a58e-eeb0540d8e46"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("ac222143-3d66-4e88-a58e-eeb0540d8e46")}} }) }
99062024-12-13T21:09:48.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ab296654-a2de-4b5d-bce0-9a86ce19f3a3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
99072024-12-13T21:09:48.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ab296654-a2de-4b5d-bce0-9a86ce19f3a3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
99082024-12-13T21:09:48.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = ab296654-a2de-4b5d-bce0-9a86ce19f3a3 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
99092024-12-13T21:09:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 081e36fa-dcf8-47e1-bc8f-c7eaaeb35f86 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99102024-12-13T21:09:49.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 081e36fa-dcf8-47e1-bc8f-c7eaaeb35f86 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99112024-12-13T21:09:49.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 081e36fa-dcf8-47e1-bc8f-c7eaaeb35f86 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99122024-12-13T21:09:50.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2ec74d73-cda7-4187-aef6-be1bf85d88cc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99132024-12-13T21:09:50.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2ec74d73-cda7-4187-aef6-be1bf85d88cc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99142024-12-13T21:09:50.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2ec74d73-cda7-4187-aef6-be1bf85d88cc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99152024-12-13T21:09:51.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 486b125c-89ec-4f87-a500-d1f9d985ffbb roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99162024-12-13T21:09:51.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 486b125c-89ec-4f87-a500-d1f9d985ffbb resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99172024-12-13T21:09:51.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 486b125c-89ec-4f87-a500-d1f9d985ffbb response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99182024-12-13T21:09:52.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e180973-2547-4c97-b5f3-ac97aed4fe07 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99192024-12-13T21:09:52.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e180973-2547-4c97-b5f3-ac97aed4fe07 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99202024-12-13T21:09:52.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6e180973-2547-4c97-b5f3-ac97aed4fe07 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99212024-12-13T21:09:53.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c57052f2-985f-441e-a5e9-36057c9ee694 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99222024-12-13T21:09:53.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c57052f2-985f-441e-a5e9-36057c9ee694 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99232024-12-13T21:09:53.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c57052f2-985f-441e-a5e9-36057c9ee694 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99242024-12-13T21:09:54.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 04a8d692-3fc8-4157-9ed8-2f9da362dfa5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99252024-12-13T21:09:54.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 04a8d692-3fc8-4157-9ed8-2f9da362dfa5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99262024-12-13T21:09:54.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 04a8d692-3fc8-4157-9ed8-2f9da362dfa5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99272024-12-13T21:09:55.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 195bbfb2-0a80-4eb7-8334-5c95aaee0241 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99282024-12-13T21:09:55.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 195bbfb2-0a80-4eb7-8334-5c95aaee0241 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99292024-12-13T21:09:55.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 195bbfb2-0a80-4eb7-8334-5c95aaee0241 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99302024-12-13T21:09:56.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5da2bd3b-f7c4-4f1c-b54d-61309fc574ef roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99312024-12-13T21:09:56.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5da2bd3b-f7c4-4f1c-b54d-61309fc574ef resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99322024-12-13T21:09:56.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5da2bd3b-f7c4-4f1c-b54d-61309fc574ef response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99332024-12-13T21:09:57.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939e37b6-c53a-4f02-864a-cdce872184a7 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99342024-12-13T21:09:57.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939e37b6-c53a-4f02-864a-cdce872184a7 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99352024-12-13T21:09:57.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939e37b6-c53a-4f02-864a-cdce872184a7 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99362024-12-13T21:09:57.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 8ded3bf8-c44c-4dc5-8e0f-4106c53b489f response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
99372024-12-13T21:09:57.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
99382024-12-13T21:09:57.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
99392024-12-13T21:09:57.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99402024-12-13T21:09:57.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99412024-12-13T21:09:57.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99422024-12-13T21:09:57.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99432024-12-13T21:09:57.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99442024-12-13T21:09:57.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99452024-12-13T21:09:57.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99462024-12-13T21:09:57.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99472024-12-13T21:09:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99482024-12-13T21:09:57.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99492024-12-13T21:09:57.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99502024-12-13T21:09:57.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
99512024-12-13T21:09:57.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99522024-12-13T21:09:57.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99532024-12-13T21:09:57.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
99542024-12-13T21:09:57.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.331498ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
99552024-12-13T21:09:57.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99562024-12-13T21:09:57.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99572024-12-13T21:09:57.752ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.147592ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99582024-12-13T21:09:58.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 84c9848c-d65d-4056-a3b0-f37aebf6136a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99592024-12-13T21:09:58.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 84c9848c-d65d-4056-a3b0-f37aebf6136a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99602024-12-13T21:09:58.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 84c9848c-d65d-4056-a3b0-f37aebf6136a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99612024-12-13T21:09:59.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a3134ae0-e612-40ec-b128-ef7b8a6c2876 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99622024-12-13T21:09:59.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a3134ae0-e612-40ec-b128-ef7b8a6c2876 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99632024-12-13T21:09:59.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a3134ae0-e612-40ec-b128-ef7b8a6c2876 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99642024-12-13T21:10:00.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a2d29f58-836e-429c-933b-e59c2d256724 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99652024-12-13T21:10:00.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a2d29f58-836e-429c-933b-e59c2d256724 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99662024-12-13T21:10:00.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a2d29f58-836e-429c-933b-e59c2d256724 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99672024-12-13T21:10:01.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f74f3d8c-791b-4981-8f10-21876f615667 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99682024-12-13T21:10:01.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f74f3d8c-791b-4981-8f10-21876f615667 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99692024-12-13T21:10:01.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f74f3d8c-791b-4981-8f10-21876f615667 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99702024-12-13T21:10:02.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9a038900-0331-4568-9680-63fdb18778d5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99712024-12-13T21:10:02.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9a038900-0331-4568-9680-63fdb18778d5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99722024-12-13T21:10:02.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9a038900-0331-4568-9680-63fdb18778d5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99732024-12-13T21:10:02.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 792af464-1e6b-4f17-8e80-d4befbf184a9 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
99742024-12-13T21:10:02.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 792af464-1e6b-4f17-8e80-d4befbf184a9 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
99752024-12-13T21:10:02.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = 792af464-1e6b-4f17-8e80-d4befbf184a9 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?sort_by=id_ascending
99762024-12-13T21:10:02.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = a65aba49-a4c4-47b0-9f56-1f5216e58538 roles = RoleSet { roles: {} } uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
99772024-12-13T21:10:02.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = a65aba49-a4c4-47b0-9f56-1f5216e58538 resource = Database result = Ok(()) uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
99782024-12-13T21:10:02.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60119 req_id = a65aba49-a4c4-47b0-9f56-1f5216e58538 response_code = 200 uri = /metrics/collectors/1f4f4352-c234-49e8-a10e-c3ed903f7462/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZmE4MmRjZS01YTIxLTQwNWItOWQwZi1hNDA3MDEzMmZmOTYifX0%3D
99792024-12-13T21:10:03.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 96cb17a3-0f5f-4bfc-9252-cf9014f2cc7f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99802024-12-13T21:10:03.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 96cb17a3-0f5f-4bfc-9252-cf9014f2cc7f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99812024-12-13T21:10:03.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 96cb17a3-0f5f-4bfc-9252-cf9014f2cc7f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99822024-12-13T21:10:04.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d626c56c-de61-46bd-9cfe-c2e4e8df115b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99832024-12-13T21:10:04.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d626c56c-de61-46bd-9cfe-c2e4e8df115b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99842024-12-13T21:10:04.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d626c56c-de61-46bd-9cfe-c2e4e8df115b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99852024-12-13T21:10:05.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 99d39934-3d89-44bb-8e39-4e03bad2307b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99862024-12-13T21:10:05.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 99d39934-3d89-44bb-8e39-4e03bad2307b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99872024-12-13T21:10:05.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 99d39934-3d89-44bb-8e39-4e03bad2307b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99882024-12-13T21:10:05.721ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61142
99892024-12-13T21:10:05.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61142 req_id = 903a6f12-8325-4dcb-86e4-4283080feb96 roles = RoleSet { roles: {} } uri = /metrics/producers
99902024-12-13T21:10:05.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61142 req_id = 903a6f12-8325-4dcb-86e4-4283080feb96 resource = Database result = Ok(()) uri = /metrics/producers
99912024-12-13T21:10:05.757ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 9808715c-dad7-4981-b1eb-a6013e471643
99922024-12-13T21:10:05.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35469 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61142 req_id = 903a6f12-8325-4dcb-86e4-4283080feb96 response_code = 201 uri = /metrics/producers
99932024-12-13T21:10:06.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa57c410-be5a-4723-afe0-4e0e1b8d58b9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99942024-12-13T21:10:06.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa57c410-be5a-4723-afe0-4e0e1b8d58b9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99952024-12-13T21:10:06.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa57c410-be5a-4723-afe0-4e0e1b8d58b9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99962024-12-13T21:10:07.664ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 8feb2263-423c-4a6b-bd43-4269525b874c response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
99972024-12-13T21:10:07.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bfa115f4-eae9-4dc6-b9e0-1fd83b1c8eee roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99982024-12-13T21:10:07.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bfa115f4-eae9-4dc6-b9e0-1fd83b1c8eee resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
99992024-12-13T21:10:07.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bfa115f4-eae9-4dc6-b9e0-1fd83b1c8eee response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
100002024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
100012024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
100022024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100032024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
100042024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100052024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100062024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
100072024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100082024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
100092024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100102024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
100112024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
100122024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100132024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
100142024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100152024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
100162024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100172024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100182024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
100192024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
100202024-12-13T21:10:07.721ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100212024-12-13T21:10:07.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100222024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100232024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
100242024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100252024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
100262024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100272024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100282024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100292024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100302024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100312024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100322024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100332024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100342024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100352024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100362024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100372024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100382024-12-13T21:10:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100392024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
100402024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
100412024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
100422024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100432024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100442024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100452024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
100462024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100472024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100482024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100492024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100502024-12-13T21:10:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100512024-12-13T21:10:07.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100522024-12-13T21:10:07.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100532024-12-13T21:10:07.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100542024-12-13T21:10:07.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1649, tv_nsec: 240954918 } })
100552024-12-13T21:10:07.725ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.794168ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100562024-12-13T21:10:07.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
100572024-12-13T21:10:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100582024-12-13T21:10:07.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100592024-12-13T21:10:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100602024-12-13T21:10:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
100612024-12-13T21:10:07.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100622024-12-13T21:10:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100632024-12-13T21:10:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100642024-12-13T21:10:07.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100652024-12-13T21:10:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100662024-12-13T21:10:07.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100672024-12-13T21:10:07.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100682024-12-13T21:10:07.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100692024-12-13T21:10:07.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100702024-12-13T21:10:07.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100712024-12-13T21:10:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100722024-12-13T21:10:07.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100732024-12-13T21:10:07.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100742024-12-13T21:10:07.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100752024-12-13T21:10:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100762024-12-13T21:10:07.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100772024-12-13T21:10:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100782024-12-13T21:10:07.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100792024-12-13T21:10:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100802024-12-13T21:10:07.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1649, tv_nsec: 252944058 } })
100812024-12-13T21:10:07.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
100822024-12-13T21:10:07.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100832024-12-13T21:10:07.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100842024-12-13T21:10:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100852024-12-13T21:10:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100862024-12-13T21:10:07.740ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1649, tv_nsec: 256015258 } })
100872024-12-13T21:10:07.741ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
100882024-12-13T21:10:07.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100892024-12-13T21:10:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100902024-12-13T21:10:07.763ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100912024-12-13T21:10:07.763ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100922024-12-13T21:10:07.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100932024-12-13T21:10:07.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100942024-12-13T21:10:07.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100952024-12-13T21:10:07.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100962024-12-13T21:10:07.770ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100972024-12-13T21:10:07.770ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
100982024-12-13T21:10:07.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100992024-12-13T21:10:07.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101002024-12-13T21:10:07.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101012024-12-13T21:10:07.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101022024-12-13T21:10:07.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101032024-12-13T21:10:07.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101042024-12-13T21:10:07.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101052024-12-13T21:10:07.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101062024-12-13T21:10:07.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101072024-12-13T21:10:07.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101082024-12-13T21:10:07.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101092024-12-13T21:10:07.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101102024-12-13T21:10:07.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101112024-12-13T21:10:07.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101122024-12-13T21:10:07.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101132024-12-13T21:10:07.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.519648ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
101142024-12-13T21:10:07.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
101152024-12-13T21:10:07.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101162024-12-13T21:10:07.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101172024-12-13T21:10:07.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.458661ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101182024-12-13T21:10:07.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.064544ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
101192024-12-13T21:10:07.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.83798ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101202024-12-13T21:10:07.780ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.688882ms iteration = 26 status = 0
101212024-12-13T21:10:07.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101222024-12-13T21:10:07.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
101232024-12-13T21:10:07.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101242024-12-13T21:10:07.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101252024-12-13T21:10:07.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101262024-12-13T21:10:07.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101272024-12-13T21:10:07.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101282024-12-13T21:10:07.786ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101292024-12-13T21:10:07.786ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.879203ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
101302024-12-13T21:10:07.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101312024-12-13T21:10:07.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101322024-12-13T21:10:07.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101332024-12-13T21:10:07.796ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
101342024-12-13T21:10:07.796ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.573845ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
101352024-12-13T21:10:07.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101362024-12-13T21:10:07.800ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101372024-12-13T21:10:07.800ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6831271-ac17-4a84-bcff-6528274fb27e", "content-length": "26", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101382024-12-13T21:10:07.800ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101392024-12-13T21:10:07.802ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101402024-12-13T21:10:07.802ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101412024-12-13T21:10:07.802ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.484227ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101422024-12-13T21:10:07.802ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101432024-12-13T21:10:07.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.120724ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101442024-12-13T21:10:07.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101452024-12-13T21:10:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101462024-12-13T21:10:07.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.355425ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101472024-12-13T21:10:07.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101482024-12-13T21:10:07.821ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101492024-12-13T21:10:07.821ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "082cd64b-82da-4a5f-abbc-61a488df1f07", "content-length": "26", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101502024-12-13T21:10:07.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101512024-12-13T21:10:07.823ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.299507ms iteration = 30 status = {"physical_disks_added":0}
101522024-12-13T21:10:07.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101532024-12-13T21:10:07.828ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
101542024-12-13T21:10:07.828ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101552024-12-13T21:10:07.828ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1b8608f-6202-49fb-84d2-2f98b059a0ee", "content-length": "26", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101562024-12-13T21:10:07.828ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101572024-12-13T21:10:07.830ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
101582024-12-13T21:10:07.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101592024-12-13T21:10:07.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101602024-12-13T21:10:07.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612024-12-13T21:10:07.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101622024-12-13T21:10:07.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101632024-12-13T21:10:07.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101642024-12-13T21:10:07.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101652024-12-13T21:10:07.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101662024-12-13T21:10:07.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101672024-12-13T21:10:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101682024-12-13T21:10:07.979ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
101692024-12-13T21:10:07.980ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "09e33b04-5051-4df8-8bdf-5c86af152557", "content-length": "2", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101702024-12-13T21:10:07.981ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101712024-12-13T21:10:07.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101722024-12-13T21:10:07.997ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
101732024-12-13T21:10:07.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101742024-12-13T21:10:07.997ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "265855b0-5952-42b1-b340-b0ff4ef9998a", "content-length": "372", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101752024-12-13T21:10:07.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101762024-12-13T21:10:07.997ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 275.916567ms iteration = 26 status = {}
101772024-12-13T21:10:07.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101782024-12-13T21:10:07.999ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 277.350524ms iteration = 26 status = null
101792024-12-13T21:10:08.001ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
101802024-12-13T21:10:08.001ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7434d2a-ea68-421c-8ad2-874b20af2da6", "content-length": "691", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101812024-12-13T21:10:08.001ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
101822024-12-13T21:10:08.001ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
101832024-12-13T21:10:08.001ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
101842024-12-13T21:10:08.003ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 281.513972ms iteration = 27 status = {}
101852024-12-13T21:10:08.012ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
101862024-12-13T21:10:08.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
101872024-12-13T21:10:08.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "00d4390d-603d-4e1e-b3d1-a67beedfe887", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101882024-12-13T21:10:08.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101892024-12-13T21:10:08.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101902024-12-13T21:10:08.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101912024-12-13T21:10:08.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101922024-12-13T21:10:08.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101932024-12-13T21:10:08.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101942024-12-13T21:10:08.022ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
101952024-12-13T21:10:08.022ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101962024-12-13T21:10:08.022ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d2ea9407-49b2-4478-ac88-405ab7d802a0", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
101972024-12-13T21:10:08.024ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 302.491806ms iteration = 28 status = {}
101982024-12-13T21:10:08.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101992024-12-13T21:10:08.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102002024-12-13T21:10:08.075ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
102012024-12-13T21:10:08.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102022024-12-13T21:10:08.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102032024-12-13T21:10:08.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102042024-12-13T21:10:08.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b3855b-0765-46a6-8045-d210d5628bed", "content-length": "134", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
102052024-12-13T21:10:08.084ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102062024-12-13T21:10:08.084ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
102072024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102082024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102092024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102102024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102112024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102122024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102132024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102142024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102152024-12-13T21:10:08.085ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
102162024-12-13T21:10:08.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102172024-12-13T21:10:08.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102182024-12-13T21:10:08.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102192024-12-13T21:10:08.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f02fd80-65e1-4329-8c39-06c148700e34", "content-length": "2", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
102202024-12-13T21:10:08.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102212024-12-13T21:10:08.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cf86869-b5d4-4772-9c02-c9db3a177f7e", "content-length": "52", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
102222024-12-13T21:10:08.087ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
102232024-12-13T21:10:08.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102242024-12-13T21:10:08.186ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "72aa79dd-d59c-4958-9bda-c654c4def8bd", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
102252024-12-13T21:10:08.186ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
102262024-12-13T21:10:08.186ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102272024-12-13T21:10:08.186ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "077e3b47-82b1-41bf-9f80-4529cc04c56c", "content-length": "682", "date": "Fri, 13 Dec 2024 21:10:07 GMT"} })
102282024-12-13T21:10:08.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102292024-12-13T21:10:08.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102302024-12-13T21:10:08.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102312024-12-13T21:10:08.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102322024-12-13T21:10:08.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102332024-12-13T21:10:08.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102342024-12-13T21:10:08.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102352024-12-13T21:10:08.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102362024-12-13T21:10:08.203ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.313314ms iteration = 26 status = {}
102372024-12-13T21:10:08.495ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61908
102382024-12-13T21:10:08.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61908 req_id = 81cf6dca-a40b-45ca-8786-b563e485fa2e roles = RoleSet { roles: {} } uri = /metrics/producers
102392024-12-13T21:10:08.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61908 req_id = 81cf6dca-a40b-45ca-8786-b563e485fa2e resource = Database result = Ok(()) uri = /metrics/producers
102402024-12-13T21:10:08.530ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 05a53e54-a11d-4f9d-b47d-dabf8673427d
102412024-12-13T21:10:08.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35294 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61908 req_id = 81cf6dca-a40b-45ca-8786-b563e485fa2e response_code = 201 uri = /metrics/producers
102422024-12-13T21:10:08.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6002c49-84d1-470d-a938-7f11792984b1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102432024-12-13T21:10:08.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6002c49-84d1-470d-a938-7f11792984b1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102442024-12-13T21:10:08.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a6002c49-84d1-470d-a938-7f11792984b1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102452024-12-13T21:10:09.290ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:41654
102462024-12-13T21:10:09.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41654 req_id = 0e76fe53-2ae9-402f-b918-d9a6066feb7b roles = RoleSet { roles: {} } uri = /metrics/producers
102472024-12-13T21:10:09.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41654 req_id = 0e76fe53-2ae9-402f-b918-d9a6066feb7b resource = Database result = Ok(()) uri = /metrics/producers
102482024-12-13T21:10:09.300ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 82024834-9725-4304-9edd-af6b519041b3
102492024-12-13T21:10:09.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9469 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41654 req_id = 0e76fe53-2ae9-402f-b918-d9a6066feb7b response_code = 201 uri = /metrics/producers
102502024-12-13T21:10:09.546ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58358
102512024-12-13T21:10:09.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58358 req_id = 85fbc791-161e-4a0f-a85e-e1e2f028a65c roles = RoleSet { roles: {} } uri = /metrics/producers
102522024-12-13T21:10:09.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58358 req_id = 85fbc791-161e-4a0f-a85e-e1e2f028a65c resource = Database result = Ok(()) uri = /metrics/producers
102532024-12-13T21:10:09.578ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 24d23071-4a22-4662-832b-fb2493a9b66b
102542024-12-13T21:10:09.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31804 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58358 req_id = 85fbc791-161e-4a0f-a85e-e1e2f028a65c response_code = 201 uri = /metrics/producers
102552024-12-13T21:10:09.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9cd70917-8150-4efa-9b97-a51f29e9a0ef roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102562024-12-13T21:10:09.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9cd70917-8150-4efa-9b97-a51f29e9a0ef resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102572024-12-13T21:10:09.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9cd70917-8150-4efa-9b97-a51f29e9a0ef response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102582024-12-13T21:10:10.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b837bc4f-b917-4ae9-b6d2-fee61c374fe2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102592024-12-13T21:10:10.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b837bc4f-b917-4ae9-b6d2-fee61c374fe2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102602024-12-13T21:10:10.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b837bc4f-b917-4ae9-b6d2-fee61c374fe2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102612024-12-13T21:10:11.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 699c49b7-7e00-4980-9448-8c867ba21003 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102622024-12-13T21:10:11.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 699c49b7-7e00-4980-9448-8c867ba21003 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102632024-12-13T21:10:11.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 699c49b7-7e00-4980-9448-8c867ba21003 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102642024-12-13T21:10:12.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0a92e5b-96a5-4030-a595-3f8761419844 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102652024-12-13T21:10:12.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0a92e5b-96a5-4030-a595-3f8761419844 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102662024-12-13T21:10:12.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e0a92e5b-96a5-4030-a595-3f8761419844 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102672024-12-13T21:10:13.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71369d33-b121-4b1a-af01-57a408aa8986 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102682024-12-13T21:10:13.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71369d33-b121-4b1a-af01-57a408aa8986 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102692024-12-13T21:10:13.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 71369d33-b121-4b1a-af01-57a408aa8986 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102702024-12-13T21:10:14.039ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55359
102712024-12-13T21:10:14.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55359 req_id = fbbceef3-20a1-4640-8010-e21b3725dd79 roles = RoleSet { roles: {} } uri = /metrics/producers
102722024-12-13T21:10:14.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55359 req_id = fbbceef3-20a1-4640-8010-e21b3725dd79 resource = Database result = Ok(()) uri = /metrics/producers
102732024-12-13T21:10:14.049ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 3f777322-11c9-4c30-9537-a1cc3a15fe00
102742024-12-13T21:10:14.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10492 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55359 req_id = fbbceef3-20a1-4640-8010-e21b3725dd79 response_code = 201 uri = /metrics/producers
102752024-12-13T21:10:14.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3773d142-947f-4321-b7ce-68be4e7e423a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102762024-12-13T21:10:14.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3773d142-947f-4321-b7ce-68be4e7e423a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102772024-12-13T21:10:14.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3773d142-947f-4321-b7ce-68be4e7e423a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102782024-12-13T21:10:15.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d2f8b43-660e-4729-9811-26000629f3fc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102792024-12-13T21:10:15.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d2f8b43-660e-4729-9811-26000629f3fc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102802024-12-13T21:10:15.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d2f8b43-660e-4729-9811-26000629f3fc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102812024-12-13T21:10:16.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8493f28b-1ad6-49a4-a5af-5455af08c543 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102822024-12-13T21:10:16.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8493f28b-1ad6-49a4-a5af-5455af08c543 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102832024-12-13T21:10:16.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8493f28b-1ad6-49a4-a5af-5455af08c543 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
102842024-12-13T21:10:17.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1451 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 9f702f6e-3a1c-4052-928b-6e650f2b6642 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
102852024-12-13T21:10:17.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
102862024-12-13T21:10:17.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102872024-12-13T21:10:17.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
102882024-12-13T21:10:17.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102892024-12-13T21:10:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102902024-12-13T21:10:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102912024-12-13T21:10:17.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102922024-12-13T21:10:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102932024-12-13T21:10:17.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102942024-12-13T21:10:17.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.536372ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102952024-12-13T21:10:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102962024-12-13T21:10:17.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102972024-12-13T21:10:17.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102982024-12-13T21:10:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102992024-12-13T21:10:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103002024-12-13T21:10:17.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103012024-12-13T21:10:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
103022024-12-13T21:10:17.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103032024-12-13T21:10:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103042024-12-13T21:10:17.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
103052024-12-13T21:10:17.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.497481ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
103062024-12-13T21:10:17.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 527e63f9-28a4-4962-8b54-434486ec57d5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103072024-12-13T21:10:17.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 527e63f9-28a4-4962-8b54-434486ec57d5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103082024-12-13T21:10:17.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 527e63f9-28a4-4962-8b54-434486ec57d5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103092024-12-13T21:10:18.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = e84e9b7f-eecc-4bf8-89c7-c6b7611e757a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
103102024-12-13T21:10:18.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = e84e9b7f-eecc-4bf8-89c7-c6b7611e757a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
103112024-12-13T21:10:18.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = e84e9b7f-eecc-4bf8-89c7-c6b7611e757a response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
103122024-12-13T21:10:18.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32dd0ace-1b79-46e1-8428-a92237b11e42 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103132024-12-13T21:10:18.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32dd0ace-1b79-46e1-8428-a92237b11e42 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103142024-12-13T21:10:18.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32dd0ace-1b79-46e1-8428-a92237b11e42 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103152024-12-13T21:10:19.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cab2c13b-1cd9-4202-bee1-97392eaeae06 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103162024-12-13T21:10:19.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cab2c13b-1cd9-4202-bee1-97392eaeae06 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103172024-12-13T21:10:19.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cab2c13b-1cd9-4202-bee1-97392eaeae06 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103182024-12-13T21:10:20.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a53bcd35-a791-439f-b04e-4bc1742d011f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103192024-12-13T21:10:20.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a53bcd35-a791-439f-b04e-4bc1742d011f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103202024-12-13T21:10:20.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a53bcd35-a791-439f-b04e-4bc1742d011f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103212024-12-13T21:10:21.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ca201c8b-f6c4-420a-ba55-694c96e937ab roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103222024-12-13T21:10:21.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ca201c8b-f6c4-420a-ba55-694c96e937ab resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103232024-12-13T21:10:21.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ca201c8b-f6c4-420a-ba55-694c96e937ab response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103242024-12-13T21:10:22.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 55f84373-33c8-4c66-b20d-083a3e6a7d23 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103252024-12-13T21:10:22.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 55f84373-33c8-4c66-b20d-083a3e6a7d23 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103262024-12-13T21:10:23.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 55f84373-33c8-4c66-b20d-083a3e6a7d23 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103272024-12-13T21:10:24.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c105f03-2266-4db1-a685-93c877897833 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103282024-12-13T21:10:24.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c105f03-2266-4db1-a685-93c877897833 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103292024-12-13T21:10:24.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2c105f03-2266-4db1-a685-93c877897833 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103302024-12-13T21:10:25.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5a9e6fb2-ed08-4b6f-8fd0-d2f1b4a188c0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103312024-12-13T21:10:25.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5a9e6fb2-ed08-4b6f-8fd0-d2f1b4a188c0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103322024-12-13T21:10:25.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5a9e6fb2-ed08-4b6f-8fd0-d2f1b4a188c0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103332024-12-13T21:10:26.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8ab91208-1514-41ac-95bf-a4feed9104b0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103342024-12-13T21:10:26.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8ab91208-1514-41ac-95bf-a4feed9104b0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103352024-12-13T21:10:26.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8ab91208-1514-41ac-95bf-a4feed9104b0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103362024-12-13T21:10:27.052ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:44025
103372024-12-13T21:10:27.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44025 req_id = 2ec48d4f-403c-458e-854a-8d76e8fca534 roles = RoleSet { roles: {} } uri = /metrics/producers
103382024-12-13T21:10:27.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44025 req_id = 2ec48d4f-403c-458e-854a-8d76e8fca534 resource = Database result = Ok(()) uri = /metrics/producers
103392024-12-13T21:10:27.062ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 80dcafa7-ddfc-4f6b-a596-bd2a7d203daf
103402024-12-13T21:10:27.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10619 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44025 req_id = 2ec48d4f-403c-458e-854a-8d76e8fca534 response_code = 201 uri = /metrics/producers
103412024-12-13T21:10:27.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 832f657c-ac22-4e7a-95ab-7f8ca1800f3b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103422024-12-13T21:10:27.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 832f657c-ac22-4e7a-95ab-7f8ca1800f3b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103432024-12-13T21:10:27.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 832f657c-ac22-4e7a-95ab-7f8ca1800f3b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103442024-12-13T21:10:27.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 434c212e-24a5-4311-b840-f76928627e98 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
103452024-12-13T21:10:27.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
103462024-12-13T21:10:27.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103472024-12-13T21:10:27.721ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
103482024-12-13T21:10:27.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103492024-12-13T21:10:27.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103502024-12-13T21:10:27.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103512024-12-13T21:10:27.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103522024-12-13T21:10:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103532024-12-13T21:10:27.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103542024-12-13T21:10:27.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.395214ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103552024-12-13T21:10:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103562024-12-13T21:10:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103572024-12-13T21:10:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103582024-12-13T21:10:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103592024-12-13T21:10:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103602024-12-13T21:10:27.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103612024-12-13T21:10:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
103622024-12-13T21:10:27.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103632024-12-13T21:10:27.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103642024-12-13T21:10:27.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
103652024-12-13T21:10:27.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.037264ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
103662024-12-13T21:10:28.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 64fade0a-5ade-4615-b3e4-364f0e1550cf roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103672024-12-13T21:10:28.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 64fade0a-5ade-4615-b3e4-364f0e1550cf resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103682024-12-13T21:10:28.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 64fade0a-5ade-4615-b3e4-364f0e1550cf response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103692024-12-13T21:10:29.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 068bcda8-db1d-45bc-860e-133503c3a977 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103702024-12-13T21:10:29.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 068bcda8-db1d-45bc-860e-133503c3a977 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103712024-12-13T21:10:29.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 068bcda8-db1d-45bc-860e-133503c3a977 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103722024-12-13T21:10:30.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 27f6d1c1-a09b-4bcc-9685-d3bf8821b633 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103732024-12-13T21:10:30.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 27f6d1c1-a09b-4bcc-9685-d3bf8821b633 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103742024-12-13T21:10:30.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 27f6d1c1-a09b-4bcc-9685-d3bf8821b633 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103752024-12-13T21:10:31.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 595803bf-448d-4b9b-a2f2-c99bae9f7df6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103762024-12-13T21:10:31.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 595803bf-448d-4b9b-a2f2-c99bae9f7df6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103772024-12-13T21:10:31.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 595803bf-448d-4b9b-a2f2-c99bae9f7df6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103782024-12-13T21:10:32.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9698675e-e28b-43c6-87a2-100034c7cb9c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103792024-12-13T21:10:32.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9698675e-e28b-43c6-87a2-100034c7cb9c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103802024-12-13T21:10:32.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9698675e-e28b-43c6-87a2-100034c7cb9c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103812024-12-13T21:10:33.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f284c320-db87-42ae-8fbc-ffebf4e28a08 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103822024-12-13T21:10:33.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f284c320-db87-42ae-8fbc-ffebf4e28a08 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103832024-12-13T21:10:33.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f284c320-db87-42ae-8fbc-ffebf4e28a08 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103842024-12-13T21:10:34.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78ccd98e-c004-49d5-8680-78da1ff2f8ba roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103852024-12-13T21:10:34.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78ccd98e-c004-49d5-8680-78da1ff2f8ba resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103862024-12-13T21:10:34.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 78ccd98e-c004-49d5-8680-78da1ff2f8ba response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103872024-12-13T21:10:35.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 981688c5-1628-4b93-a5e6-1e0b04d20e81 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103882024-12-13T21:10:35.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 981688c5-1628-4b93-a5e6-1e0b04d20e81 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103892024-12-13T21:10:35.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 981688c5-1628-4b93-a5e6-1e0b04d20e81 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103902024-12-13T21:10:36.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b49b6528-2c96-4ee7-b43d-0ef1a54d0d40 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103912024-12-13T21:10:36.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b49b6528-2c96-4ee7-b43d-0ef1a54d0d40 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103922024-12-13T21:10:36.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b49b6528-2c96-4ee7-b43d-0ef1a54d0d40 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103932024-12-13T21:10:37.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69add278-b6d5-4b3b-afd8-b84806d23c72 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103942024-12-13T21:10:37.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69add278-b6d5-4b3b-afd8-b84806d23c72 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103952024-12-13T21:10:37.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 69add278-b6d5-4b3b-afd8-b84806d23c72 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
103962024-12-13T21:10:37.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 4cac6c6f-5367-4446-9427-782bc5d459e0 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
103972024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
103982024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
103992024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104002024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
104012024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104022024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104032024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
104042024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
104052024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104062024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104072024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
104082024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
104092024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104102024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
104112024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
104122024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104132024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
104142024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
104152024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104162024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
104172024-12-13T21:10:37.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104182024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
104192024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104202024-12-13T21:10:37.722ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69
104212024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.24\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69"}
104222024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
104232024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
104242024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104252024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
104262024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
104272024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
104282024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104292024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
104302024-12-13T21:10:37.722ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-13 21:00:37.722427338 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
104312024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
104322024-12-13T21:10:37.722ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
104332024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
104342024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104352024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
104362024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104372024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
104382024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104392024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104402024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
104412024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
104422024-12-13T21:10:37.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
104432024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104442024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104452024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
104462024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104472024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
104482024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
104492024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
104502024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
104512024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
104522024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
104532024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
104542024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104552024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
104562024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104572024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104582024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
104592024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104602024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104612024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104622024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104632024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104642024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104652024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104662024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104672024-12-13T21:10:37.723ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("233edeea-165b-49f4-9d3a-4e81983c0e1e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7872b736-f2e1-4c06-b4bc-930654cf3232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8fec4e6b-8b92-411a-ab0d-dc1317b380d5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 238803616 } })
104682024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104692024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104702024-12-13T21:10:37.723ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8fa769ab-44ab-4529-aca4-cf239281d788.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d9f46008-cfe6-449f-ba60-44c3baf9576d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 238875878 } })
104712024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104722024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
104732024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104742024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
104752024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
104762024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104772024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104782024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104792024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
104802024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
104812024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104822024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
104832024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104842024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104852024-12-13T21:10:37.723ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
104862024-12-13T21:10:37.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
104872024-12-13T21:10:37.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.623053ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
104882024-12-13T21:10:37.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.726045ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
104892024-12-13T21:10:37.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104902024-12-13T21:10:37.725ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.263495ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104912024-12-13T21:10:37.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104922024-12-13T21:10:37.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104932024-12-13T21:10:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104942024-12-13T21:10:37.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104952024-12-13T21:10:37.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 242294346 } })
104962024-12-13T21:10:37.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104972024-12-13T21:10:37.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
104982024-12-13T21:10:37.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104992024-12-13T21:10:37.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105002024-12-13T21:10:37.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105012024-12-13T21:10:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105022024-12-13T21:10:37.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105032024-12-13T21:10:37.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105042024-12-13T21:10:37.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105052024-12-13T21:10:37.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105062024-12-13T21:10:37.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105072024-12-13T21:10:37.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105082024-12-13T21:10:37.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105092024-12-13T21:10:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105102024-12-13T21:10:37.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105112024-12-13T21:10:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105122024-12-13T21:10:37.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105132024-12-13T21:10:37.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105142024-12-13T21:10:37.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105152024-12-13T21:10:37.733ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105162024-12-13T21:10:37.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105172024-12-13T21:10:37.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105182024-12-13T21:10:37.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105192024-12-13T21:10:37.735ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105202024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105212024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105222024-12-13T21:10:37.735ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-13 21:00:37.722427338 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105232024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.041409ms iteration = 14 status = {"expiration":"2024-12-13T21:00:37.722427338Z","pruned":[]}
105242024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105252024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
105262024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105272024-12-13T21:10:37.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105282024-12-13T21:10:37.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105292024-12-13T21:10:37.738ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.79354ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
105302024-12-13T21:10:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105312024-12-13T21:10:37.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105322024-12-13T21:10:37.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105332024-12-13T21:10:37.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105342024-12-13T21:10:37.741ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
105352024-12-13T21:10:37.741ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
105362024-12-13T21:10:37.741ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.979632ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
105372024-12-13T21:10:37.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 257582343 } })
105382024-12-13T21:10:37.742ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
105392024-12-13T21:10:37.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105402024-12-13T21:10:37.742ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105412024-12-13T21:10:37.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105422024-12-13T21:10:37.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.112983ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105432024-12-13T21:10:37.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105442024-12-13T21:10:37.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105452024-12-13T21:10:37.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105462024-12-13T21:10:37.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105472024-12-13T21:10:37.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105482024-12-13T21:10:37.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105492024-12-13T21:10:37.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 262691425 } })
105502024-12-13T21:10:37.747ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
105512024-12-13T21:10:37.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105522024-12-13T21:10:37.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105532024-12-13T21:10:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105542024-12-13T21:10:37.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105552024-12-13T21:10:37.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105562024-12-13T21:10:37.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105572024-12-13T21:10:37.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105582024-12-13T21:10:37.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105592024-12-13T21:10:37.755ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105602024-12-13T21:10:37.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105612024-12-13T21:10:37.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105622024-12-13T21:10:37.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105632024-12-13T21:10:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
105642024-12-13T21:10:37.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105652024-12-13T21:10:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105662024-12-13T21:10:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
105672024-12-13T21:10:37.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105682024-12-13T21:10:37.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105692024-12-13T21:10:37.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105702024-12-13T21:10:37.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105712024-12-13T21:10:37.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105722024-12-13T21:10:37.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105732024-12-13T21:10:37.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.017784ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
105742024-12-13T21:10:37.772ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
105752024-12-13T21:10:37.772ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.52424ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
105762024-12-13T21:10:37.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.233733ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
105772024-12-13T21:10:37.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105782024-12-13T21:10:37.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105792024-12-13T21:10:37.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105802024-12-13T21:10:37.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105812024-12-13T21:10:37.776ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105822024-12-13T21:10:37.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105832024-12-13T21:10:37.778ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105842024-12-13T21:10:37.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105852024-12-13T21:10:37.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105862024-12-13T21:10:37.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105872024-12-13T21:10:37.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105882024-12-13T21:10:37.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105892024-12-13T21:10:37.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105902024-12-13T21:10:37.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105912024-12-13T21:10:37.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105922024-12-13T21:10:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
105932024-12-13T21:10:37.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105942024-12-13T21:10:37.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105952024-12-13T21:10:37.790ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.671541ms iteration = 27 status = 0
105962024-12-13T21:10:37.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105972024-12-13T21:10:37.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105982024-12-13T21:10:37.793ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
105992024-12-13T21:10:37.794ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
106002024-12-13T21:10:37.794ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
106012024-12-13T21:10:37.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106022024-12-13T21:10:37.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106032024-12-13T21:10:37.794ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106042024-12-13T21:10:37.794ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106052024-12-13T21:10:37.794ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.066849ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
106062024-12-13T21:10:37.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106072024-12-13T21:10:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106082024-12-13T21:10:37.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106092024-12-13T21:10:37.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106102024-12-13T21:10:37.799ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
106112024-12-13T21:10:37.799ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
106122024-12-13T21:10:37.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106132024-12-13T21:10:37.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106142024-12-13T21:10:37.801ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106152024-12-13T21:10:37.801ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106162024-12-13T21:10:37.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106172024-12-13T21:10:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106182024-12-13T21:10:37.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106192024-12-13T21:10:37.804ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106202024-12-13T21:10:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.804932ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106212024-12-13T21:10:37.805ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106222024-12-13T21:10:37.805ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106232024-12-13T21:10:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.686434ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106242024-12-13T21:10:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106252024-12-13T21:10:37.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106262024-12-13T21:10:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106272024-12-13T21:10:37.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106282024-12-13T21:10:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106292024-12-13T21:10:37.813ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 066df8f2-bc73-4ade-abd9-bf8fbf0e0c41 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
106302024-12-13T21:10:37.813ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
106312024-12-13T21:10:37.813ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-13 20:58:05.752831 UTC dns_group = internal generation = 1
106322024-12-13T21:10:37.813ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 91.715679ms iteration = 15 status = {"generation":1}
106332024-12-13T21:10:37.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.011557ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106342024-12-13T21:10:37.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106352024-12-13T21:10:37.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106362024-12-13T21:10:37.816ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106372024-12-13T21:10:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106382024-12-13T21:10:37.818ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
106392024-12-13T21:10:37.818ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
106402024-12-13T21:10:37.818ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
106412024-12-13T21:10:37.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106422024-12-13T21:10:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106432024-12-13T21:10:37.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106442024-12-13T21:10:37.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.875781ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106452024-12-13T21:10:37.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106462024-12-13T21:10:37.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106472024-12-13T21:10:37.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106482024-12-13T21:10:37.826ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
106492024-12-13T21:10:37.826ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 0 version = 2
106502024-12-13T21:10:37.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106512024-12-13T21:10:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106522024-12-13T21:10:37.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106532024-12-13T21:10:37.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.27963ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106542024-12-13T21:10:37.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106552024-12-13T21:10:37.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106562024-12-13T21:10:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106572024-12-13T21:10:37.832ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0893fc2b-b43f-4175-bbcc-bb5e51aeaf90 dns_zone_name = oxide.test found_so_far = 1 version = 2
106582024-12-13T21:10:37.832ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
106592024-12-13T21:10:37.832ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-13 20:58:07.455374 UTC dns_group = external generation = 2
106602024-12-13T21:10:37.832ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 109.793548ms iteration = 15 status = {"generation":2}
106612024-12-13T21:10:37.838ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
106622024-12-13T21:10:37.838ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 116.42448ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
106632024-12-13T21:10:37.847ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
106642024-12-13T21:10:37.853ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-13T20:57:32.253701Z, time_modified: 2024-12-13T20:57:32.253701Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9b17a900-d817-4355-ae3b-0335ac1f374b, db_silo: Silo { identity: SiloIdentity { id: 9b17a900-d817-4355-ae3b-0335ac1f374b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-13T20:58:07.383036Z, time_modified: 2024-12-13T20:58:07.383036Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3" }] }) }
106652024-12-13T21:10:37.853ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 131.584733ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]}},"default_endpoint":{"silo_id":"9b17a900-d817-4355-ae3b-0335ac1f374b","tls_certs":["0666d9a92adcb7e853cea3a0410df15008f724588ffe98a977c89001904052e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
106662024-12-13T21:10:37.859ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106672024-12-13T21:10:37.859ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106682024-12-13T21:10:37.860ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb3f5e82-5ff5-4717-a2d4-60a285887727", "content-length": "26", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
106692024-12-13T21:10:37.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106702024-12-13T21:10:37.861ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106712024-12-13T21:10:37.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
106722024-12-13T21:10:37.877ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.498317ms iteration = 31 status = {"physical_disks_added":0}
106732024-12-13T21:10:37.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106742024-12-13T21:10:37.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106752024-12-13T21:10:37.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106762024-12-13T21:10:37.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106772024-12-13T21:10:37.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106782024-12-13T21:10:37.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106792024-12-13T21:10:37.991ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106802024-12-13T21:10:37.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106812024-12-13T21:10:37.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b3701fd-049c-4c01-9c57-152ed534bec0", "content-length": "372", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
106822024-12-13T21:10:37.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106832024-12-13T21:10:37.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106842024-12-13T21:10:37.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106852024-12-13T21:10:38.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106862024-12-13T21:10:38.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106872024-12-13T21:10:38.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106882024-12-13T21:10:38.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
106892024-12-13T21:10:38.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
106902024-12-13T21:10:38.034ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106912024-12-13T21:10:38.034ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72499e7d-252f-465f-9c57-ebe627228726", "content-length": "26", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
106922024-12-13T21:10:38.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106932024-12-13T21:10:38.036ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106942024-12-13T21:10:38.036ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e567edb5-9eff-4f67-99eb-139cc4e337ce", "content-length": "2", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
106952024-12-13T21:10:38.037ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
106962024-12-13T21:10:38.039ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106972024-12-13T21:10:38.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106982024-12-13T21:10:38.041ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.60279ms iteration = 27 status = null
106992024-12-13T21:10:38.047ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107002024-12-13T21:10:38.047ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107012024-12-13T21:10:38.047ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "694a46d1-44d8-4be6-8d07-d1a056f91540", "content-length": "26", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107022024-12-13T21:10:38.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107032024-12-13T21:10:38.048ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
107042024-12-13T21:10:38.049ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bbc6ef69-64ca-4e1c-bd02-cb89ce8fccd8", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
107052024-12-13T21:10:38.049ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
107062024-12-13T21:10:38.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107072024-12-13T21:10:38.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c17109ba-ac36-4728-836c-240cf31fa407", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
107082024-12-13T21:10:38.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
107092024-12-13T21:10:38.052ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
107102024-12-13T21:10:38.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 330.370909ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
107112024-12-13T21:10:38.061ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107122024-12-13T21:10:38.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107132024-12-13T21:10:38.061ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "478f413b-1dc5-4f4e-a70e-2efe71caf9ec", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107142024-12-13T21:10:38.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107152024-12-13T21:10:38.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107162024-12-13T21:10:38.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107172024-12-13T21:10:38.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107182024-12-13T21:10:38.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107192024-12-13T21:10:38.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107202024-12-13T21:10:38.069ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107212024-12-13T21:10:38.069ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107222024-12-13T21:10:38.070ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7fbfe593-4a89-4e89-842c-480fdb638761", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107232024-12-13T21:10:38.072ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.308687ms iteration = 29 status = {}
107242024-12-13T21:10:38.141ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 419.086871ms iteration = 27 status = {}
107252024-12-13T21:10:38.179ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107262024-12-13T21:10:38.180ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e83259e-fcb7-494f-a457-b66cc169ebbd", "content-length": "691", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107272024-12-13T21:10:38.180ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
107282024-12-13T21:10:38.180ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
107292024-12-13T21:10:38.180ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
107302024-12-13T21:10:38.181ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.532509ms iteration = 28 status = {}
107312024-12-13T21:10:38.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
107322024-12-13T21:10:38.216ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1de1bddb-5b4f-4e00-affb-47c1144c967f", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107332024-12-13T21:10:38.216ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107342024-12-13T21:10:38.218ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "03a4aa37-4abb-4377-b33b-d3c6953dba13", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107352024-12-13T21:10:38.218ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107362024-12-13T21:10:38.219ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b6270a6f-0b3f-49e6-ab2f-b9214749bceb", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107372024-12-13T21:10:38.219ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107382024-12-13T21:10:38.222ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
107392024-12-13T21:10:38.222ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 499.930537ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
107402024-12-13T21:10:38.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107412024-12-13T21:10:38.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107422024-12-13T21:10:38.280ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
107432024-12-13T21:10:38.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107442024-12-13T21:10:38.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107452024-12-13T21:10:38.290ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107462024-12-13T21:10:38.290ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c1b7f26-ed75-41bb-be0d-1e2385bbeaf3", "content-length": "134", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107472024-12-13T21:10:38.290ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107482024-12-13T21:10:38.290ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
107492024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107502024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107512024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107522024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107532024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107542024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107552024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107562024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107572024-12-13T21:10:38.291ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
107582024-12-13T21:10:38.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107592024-12-13T21:10:38.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107602024-12-13T21:10:38.293ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107612024-12-13T21:10:38.293ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8afe1a0d-ef4e-4bcc-9f9d-a57853b45caa", "content-length": "2", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107622024-12-13T21:10:38.293ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107632024-12-13T21:10:38.293ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec4804a8-46ab-4e6a-85fb-815d3e17d4f8", "content-length": "52", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107642024-12-13T21:10:38.293ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
107652024-12-13T21:10:38.293ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107662024-12-13T21:10:38.387ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cbee2220-e6f3-460e-af53-06c53cacefc3", "date": "Fri, 13 Dec 2024 21:10:37 GMT"} })
107672024-12-13T21:10:38.387ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
107682024-12-13T21:10:38.387ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107692024-12-13T21:10:38.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7ed5e91c-a114-4bad-b606-f60fa51a09c5 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107702024-12-13T21:10:38.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7ed5e91c-a114-4bad-b606-f60fa51a09c5 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107712024-12-13T21:10:38.387ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "db2bb277-b867-4c39-9ad1-592b4b8ced50", "content-length": "682", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} })
107722024-12-13T21:10:38.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107732024-12-13T21:10:38.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107742024-12-13T21:10:38.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7ed5e91c-a114-4bad-b606-f60fa51a09c5 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107752024-12-13T21:10:38.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107762024-12-13T21:10:38.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107772024-12-13T21:10:38.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107782024-12-13T21:10:38.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107792024-12-13T21:10:38.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107802024-12-13T21:10:38.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107812024-12-13T21:10:38.404ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 682.682706ms iteration = 27 status = {}
107822024-12-13T21:10:39.191ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
107832024-12-13T21:10:39.191ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
107842024-12-13T21:10:39.221ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
107852024-12-13T21:10:39.221ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:43175
107862024-12-13T21:10:39.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43175 req_id = 8709a122-8f75-45f4-938d-25c733758873 roles = RoleSet { roles: {} } uri = /metrics/producers
107872024-12-13T21:10:39.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43175 req_id = 8709a122-8f75-45f4-938d-25c733758873 resource = Database result = Ok(()) uri = /metrics/producers
107882024-12-13T21:10:39.256ZINFOnexus: assigned collector to new producer collector_id = 1f4f4352-c234-49e8-a10e-c3ed903f7462 file = nexus/src/app/oximeter.rs:76 producer_id = 0599e804-8800-4951-9d87-7a8a49a507a3
107892024-12-13T21:10:39.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35382 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43175 req_id = 8709a122-8f75-45f4-938d-25c733758873 response_code = 201 uri = /metrics/producers
107902024-12-13T21:10:39.257ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8709a122-8f75-45f4-938d-25c733758873", "content-length": "41", "date": "Fri, 13 Dec 2024 21:10:38 GMT"} })
107912024-12-13T21:10:39.258ZDEBGnexus (producer-registration-task): registered with nexus successfully
107922024-12-13T21:10:39.258ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
107932024-12-13T21:10:39.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 328ee0ce-1ed6-452f-80d5-dc7478aa7a0e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107942024-12-13T21:10:39.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 328ee0ce-1ed6-452f-80d5-dc7478aa7a0e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107952024-12-13T21:10:39.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 328ee0ce-1ed6-452f-80d5-dc7478aa7a0e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107962024-12-13T21:10:40.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32edc502-17df-46d2-b234-444e3fa7b35a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107972024-12-13T21:10:40.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32edc502-17df-46d2-b234-444e3fa7b35a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107982024-12-13T21:10:40.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 32edc502-17df-46d2-b234-444e3fa7b35a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
107992024-12-13T21:10:41.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6c2b2d05-73cf-47d0-92cd-518365cd9678 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108002024-12-13T21:10:41.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6c2b2d05-73cf-47d0-92cd-518365cd9678 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108012024-12-13T21:10:41.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6c2b2d05-73cf-47d0-92cd-518365cd9678 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108022024-12-13T21:10:42.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a1d3632f-d72b-4db1-8490-86156b18f8a9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108032024-12-13T21:10:42.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a1d3632f-d72b-4db1-8490-86156b18f8a9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108042024-12-13T21:10:42.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = a1d3632f-d72b-4db1-8490-86156b18f8a9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108052024-12-13T21:10:43.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dafc2da2-bafb-4960-b152-7459a9674684 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108062024-12-13T21:10:43.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dafc2da2-bafb-4960-b152-7459a9674684 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108072024-12-13T21:10:43.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = dafc2da2-bafb-4960-b152-7459a9674684 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108082024-12-13T21:10:44.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2a41c603-eccc-4dfc-ae93-1d91a5323984 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108092024-12-13T21:10:44.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2a41c603-eccc-4dfc-ae93-1d91a5323984 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108102024-12-13T21:10:44.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2a41c603-eccc-4dfc-ae93-1d91a5323984 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108112024-12-13T21:10:45.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde58696-0dd5-404e-b777-8c5b4b45d4f6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108122024-12-13T21:10:45.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde58696-0dd5-404e-b777-8c5b4b45d4f6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108132024-12-13T21:10:45.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde58696-0dd5-404e-b777-8c5b4b45d4f6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108142024-12-13T21:10:46.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1e1bd994-b9ff-41c2-bafa-a5589d8b007d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108152024-12-13T21:10:46.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1e1bd994-b9ff-41c2-bafa-a5589d8b007d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108162024-12-13T21:10:46.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1e1bd994-b9ff-41c2-bafa-a5589d8b007d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108172024-12-13T21:10:47.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1b6fcf72-f82b-4c8f-9f73-7791110bd081 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108182024-12-13T21:10:47.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1b6fcf72-f82b-4c8f-9f73-7791110bd081 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108192024-12-13T21:10:47.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1b6fcf72-f82b-4c8f-9f73-7791110bd081 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108202024-12-13T21:10:47.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1438 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = b7c80315-6945-4572-a752-eb5775e5bd29 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
108212024-12-13T21:10:47.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
108222024-12-13T21:10:47.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
108232024-12-13T21:10:47.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108242024-12-13T21:10:47.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108252024-12-13T21:10:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108262024-12-13T21:10:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108272024-12-13T21:10:47.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108282024-12-13T21:10:47.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108292024-12-13T21:10:47.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108302024-12-13T21:10:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108312024-12-13T21:10:47.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108322024-12-13T21:10:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108332024-12-13T21:10:47.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108342024-12-13T21:10:47.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108352024-12-13T21:10:47.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108362024-12-13T21:10:47.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
108372024-12-13T21:10:47.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108382024-12-13T21:10:47.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108392024-12-13T21:10:47.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
108402024-12-13T21:10:47.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.243675ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
108412024-12-13T21:10:47.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.144398ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108422024-12-13T21:10:48.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 03b02c78-47c9-46f7-9352-bd540349d3fe roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108432024-12-13T21:10:48.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 03b02c78-47c9-46f7-9352-bd540349d3fe resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108442024-12-13T21:10:48.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 03b02c78-47c9-46f7-9352-bd540349d3fe response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108452024-12-13T21:10:48.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 8cbb4793-3728-460c-bea6-2a6d4343f020 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
108462024-12-13T21:10:48.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 8cbb4793-3728-460c-bea6-2a6d4343f020 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
108472024-12-13T21:10:48.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 8cbb4793-3728-460c-bea6-2a6d4343f020 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
108482024-12-13T21:10:49.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f8e06ab-069e-4ee8-9382-f46a812b03ed roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108492024-12-13T21:10:49.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f8e06ab-069e-4ee8-9382-f46a812b03ed resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108502024-12-13T21:10:49.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7f8e06ab-069e-4ee8-9382-f46a812b03ed response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108512024-12-13T21:10:50.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c234370a-10b7-4754-a9a9-3800b3e63bab roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108522024-12-13T21:10:50.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c234370a-10b7-4754-a9a9-3800b3e63bab resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108532024-12-13T21:10:50.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c234370a-10b7-4754-a9a9-3800b3e63bab response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108542024-12-13T21:10:51.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e159b80d-1e22-4f01-9b67-c062a35284ca roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108552024-12-13T21:10:51.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e159b80d-1e22-4f01-9b67-c062a35284ca resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108562024-12-13T21:10:51.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = e159b80d-1e22-4f01-9b67-c062a35284ca response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108572024-12-13T21:10:52.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff109e00-b7c1-4fa5-8a11-a0c6accd95d2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108582024-12-13T21:10:52.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff109e00-b7c1-4fa5-8a11-a0c6accd95d2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108592024-12-13T21:10:52.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ff109e00-b7c1-4fa5-8a11-a0c6accd95d2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108602024-12-13T21:10:53.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939a230c-9068-4bbb-9ced-5e4f501b44ed roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108612024-12-13T21:10:53.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939a230c-9068-4bbb-9ced-5e4f501b44ed resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108622024-12-13T21:10:53.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939a230c-9068-4bbb-9ced-5e4f501b44ed response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108632024-12-13T21:10:54.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = edb8bcb3-cee3-4d2d-9818-2346c236f8c4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108642024-12-13T21:10:54.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = edb8bcb3-cee3-4d2d-9818-2346c236f8c4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108652024-12-13T21:10:54.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = edb8bcb3-cee3-4d2d-9818-2346c236f8c4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108662024-12-13T21:10:55.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fa8fb16e-83f2-4403-a231-5f180a246ae0 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108672024-12-13T21:10:55.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fa8fb16e-83f2-4403-a231-5f180a246ae0 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108682024-12-13T21:10:55.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = fa8fb16e-83f2-4403-a231-5f180a246ae0 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108692024-12-13T21:10:56.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bcc67b38-e6fa-4296-be49-816d1307a33d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108702024-12-13T21:10:56.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bcc67b38-e6fa-4296-be49-816d1307a33d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108712024-12-13T21:10:56.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bcc67b38-e6fa-4296-be49-816d1307a33d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108722024-12-13T21:10:57.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 29ccbac1-3bef-4e03-82f3-5c8caf24f2f8 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
108732024-12-13T21:10:57.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
108742024-12-13T21:10:57.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108752024-12-13T21:10:57.721ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
108762024-12-13T21:10:57.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108772024-12-13T21:10:57.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108782024-12-13T21:10:57.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108792024-12-13T21:10:57.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108802024-12-13T21:10:57.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108812024-12-13T21:10:57.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108822024-12-13T21:10:57.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108832024-12-13T21:10:57.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108842024-12-13T21:10:57.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108852024-12-13T21:10:57.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108862024-12-13T21:10:57.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108872024-12-13T21:10:57.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108882024-12-13T21:10:57.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
108892024-12-13T21:10:57.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108902024-12-13T21:10:57.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108912024-12-13T21:10:57.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
108922024-12-13T21:10:57.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.852053ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
108932024-12-13T21:10:57.752ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.017335ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108942024-12-13T21:10:57.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 67d15e5e-3377-4254-b18a-56845a97be63 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108952024-12-13T21:10:57.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 67d15e5e-3377-4254-b18a-56845a97be63 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108962024-12-13T21:10:57.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 67d15e5e-3377-4254-b18a-56845a97be63 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108972024-12-13T21:10:58.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 264ec97b-2c48-488d-9443-ab37dd262f99 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108982024-12-13T21:10:58.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 264ec97b-2c48-488d-9443-ab37dd262f99 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
108992024-12-13T21:10:58.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 264ec97b-2c48-488d-9443-ab37dd262f99 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109002024-12-13T21:10:59.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b5a3fdd5-1842-4fa3-ba4a-54bdd152473f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109012024-12-13T21:10:59.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b5a3fdd5-1842-4fa3-ba4a-54bdd152473f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109022024-12-13T21:10:59.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b5a3fdd5-1842-4fa3-ba4a-54bdd152473f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109032024-12-13T21:11:00.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5c50535e-cd55-42da-9d7b-668cdae57f47 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109042024-12-13T21:11:00.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5c50535e-cd55-42da-9d7b-668cdae57f47 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109052024-12-13T21:11:00.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 5c50535e-cd55-42da-9d7b-668cdae57f47 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109062024-12-13T21:11:01.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f7cf8b6-3a30-4607-a8cf-5a579c917f16 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109072024-12-13T21:11:01.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f7cf8b6-3a30-4607-a8cf-5a579c917f16 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109082024-12-13T21:11:01.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8f7cf8b6-3a30-4607-a8cf-5a579c917f16 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109092024-12-13T21:11:02.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f93f8887-327d-493e-974a-3e488867df5f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109102024-12-13T21:11:02.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f93f8887-327d-493e-974a-3e488867df5f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109112024-12-13T21:11:02.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f93f8887-327d-493e-974a-3e488867df5f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109122024-12-13T21:11:03.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939625e5-04f6-4280-9630-846c03b3dd85 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109132024-12-13T21:11:03.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939625e5-04f6-4280-9630-846c03b3dd85 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109142024-12-13T21:11:03.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 939625e5-04f6-4280-9630-846c03b3dd85 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109152024-12-13T21:11:04.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2a79b1e6-ecf7-4a47-9864-8c4e351cf278 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109162024-12-13T21:11:04.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2a79b1e6-ecf7-4a47-9864-8c4e351cf278 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109172024-12-13T21:11:04.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2a79b1e6-ecf7-4a47-9864-8c4e351cf278 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109182024-12-13T21:11:05.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d601752b-30be-4e6a-9ed8-0144138e6dc2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109192024-12-13T21:11:05.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d601752b-30be-4e6a-9ed8-0144138e6dc2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109202024-12-13T21:11:05.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = d601752b-30be-4e6a-9ed8-0144138e6dc2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109212024-12-13T21:11:06.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77482660-93d2-431d-bae5-1a6a1c1c0910 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109222024-12-13T21:11:06.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77482660-93d2-431d-bae5-1a6a1c1c0910 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109232024-12-13T21:11:06.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 77482660-93d2-431d-bae5-1a6a1c1c0910 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
109242024-12-13T21:11:07.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1613 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 32f596d8-6dc0-40ea-8bd7-f62b66ba87f4 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
109252024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
109262024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
109272024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109282024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109292024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
109302024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
109312024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109322024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
109332024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
109342024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
109352024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109362024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
109372024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109382024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109392024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
109402024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
109412024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109422024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109432024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
109442024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109452024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
109462024-12-13T21:11:07.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109472024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109482024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
109492024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109502024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
109512024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109522024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
109532024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109542024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
109552024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109562024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
109572024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109582024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
109592024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109602024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109612024-12-13T21:11:07.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109622024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109632024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109642024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109652024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109662024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
109672024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109682024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109692024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109702024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
109712024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109722024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109732024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109742024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
109752024-12-13T21:11:07.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109762024-12-13T21:11:07.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109772024-12-13T21:11:07.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109782024-12-13T21:11:07.726ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.470906ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
109792024-12-13T21:11:07.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
109802024-12-13T21:11:07.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109812024-12-13T21:11:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109822024-12-13T21:11:07.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109832024-12-13T21:11:07.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109842024-12-13T21:11:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109852024-12-13T21:11:07.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109862024-12-13T21:11:07.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109872024-12-13T21:11:07.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 246905507 } })
109882024-12-13T21:11:07.731ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
109892024-12-13T21:11:07.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109902024-12-13T21:11:07.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 248184250 } })
109912024-12-13T21:11:07.732ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
109922024-12-13T21:11:07.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.665737ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
109932024-12-13T21:11:07.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109942024-12-13T21:11:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109952024-12-13T21:11:07.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109962024-12-13T21:11:07.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109972024-12-13T21:11:07.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109982024-12-13T21:11:07.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109992024-12-13T21:11:07.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110002024-12-13T21:11:07.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110012024-12-13T21:11:07.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110022024-12-13T21:11:07.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110032024-12-13T21:11:07.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110042024-12-13T21:11:07.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110052024-12-13T21:11:07.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110062024-12-13T21:11:07.755ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110072024-12-13T21:11:07.755ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110082024-12-13T21:11:07.755ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110092024-12-13T21:11:07.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110102024-12-13T21:11:07.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110112024-12-13T21:11:07.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110122024-12-13T21:11:07.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110132024-12-13T21:11:07.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110142024-12-13T21:11:07.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110152024-12-13T21:11:07.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110162024-12-13T21:11:07.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110172024-12-13T21:11:07.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110182024-12-13T21:11:07.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110192024-12-13T21:11:07.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110202024-12-13T21:11:07.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110212024-12-13T21:11:07.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110222024-12-13T21:11:07.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110232024-12-13T21:11:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110242024-12-13T21:11:07.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110252024-12-13T21:11:07.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110262024-12-13T21:11:07.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-82024834-9725-4304-9edd-af6b519041b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 290141668 } })
110272024-12-13T21:11:07.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
110282024-12-13T21:11:07.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.669722ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
110292024-12-13T21:11:07.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.266353ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110302024-12-13T21:11:07.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110312024-12-13T21:11:07.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110322024-12-13T21:11:07.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110332024-12-13T21:11:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110342024-12-13T21:11:07.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110352024-12-13T21:11:07.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110362024-12-13T21:11:07.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110372024-12-13T21:11:07.789ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
110382024-12-13T21:11:07.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.71301ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
110392024-12-13T21:11:07.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
110402024-12-13T21:11:07.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110412024-12-13T21:11:07.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.623851ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110422024-12-13T21:11:07.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110432024-12-13T21:11:07.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
110442024-12-13T21:11:07.798ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110452024-12-13T21:11:07.799ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82b4f623-10f7-41bb-ba76-733506973222", "content-length": "26", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
110462024-12-13T21:11:07.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110472024-12-13T21:11:07.800ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110482024-12-13T21:11:07.800ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
110492024-12-13T21:11:07.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110502024-12-13T21:11:07.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110512024-12-13T21:11:07.801ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110522024-12-13T21:11:07.803ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
110532024-12-13T21:11:07.803ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.684679ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
110542024-12-13T21:11:07.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110552024-12-13T21:11:07.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.600688ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
110562024-12-13T21:11:07.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110572024-12-13T21:11:07.807ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
110582024-12-13T21:11:07.807ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110592024-12-13T21:11:07.807ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed1f1b2f-d9ac-4d32-84fe-979fbe525b0a", "content-length": "26", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
110602024-12-13T21:11:07.807ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110612024-12-13T21:11:07.809ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110622024-12-13T21:11:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 82024834-9725-4304-9edd-af6b519041b3, lookup_type: ById(82024834-9725-4304-9edd-af6b519041b3) } result = Ok(())
110632024-12-13T21:11:07.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110642024-12-13T21:11:07.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110652024-12-13T21:11:07.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110662024-12-13T21:11:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110672024-12-13T21:11:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110682024-12-13T21:11:07.812ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.961344ms iteration = 28 status = 0
110692024-12-13T21:11:07.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110702024-12-13T21:11:07.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110712024-12-13T21:11:07.832ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110722024-12-13T21:11:07.832ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110732024-12-13T21:11:07.832ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.457905ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110742024-12-13T21:11:07.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 zone_address = fd00:1122:3344:101::2
110752024-12-13T21:11:07.849ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110762024-12-13T21:11:07.850ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b27efa9-902b-434f-bdc3-b7daa963d08f", "content-length": "26", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
110772024-12-13T21:11:07.850ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110782024-12-13T21:11:07.852ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
110792024-12-13T21:11:07.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.102396ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
110802024-12-13T21:11:07.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110812024-12-13T21:11:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110822024-12-13T21:11:07.882ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.868596ms iteration = 32 status = {"physical_disks_added":0}
110832024-12-13T21:11:07.896ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110842024-12-13T21:11:07.896ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb0a0b74-80a6-46ca-ac7d-9320f70ec196", "content-length": "2", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
110852024-12-13T21:11:07.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110862024-12-13T21:11:07.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110872024-12-13T21:11:07.900ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.253244ms iteration = 28 status = null
110882024-12-13T21:11:07.902ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 180.305727ms iteration = 28 status = {}
110892024-12-13T21:11:07.961ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110902024-12-13T21:11:07.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110912024-12-13T21:11:07.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "be41a55b-1269-40d4-a1d2-928bf7df4f5a", "content-length": "372", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
110922024-12-13T21:11:07.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110932024-12-13T21:11:07.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110942024-12-13T21:11:07.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110952024-12-13T21:11:07.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110962024-12-13T21:11:08.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110972024-12-13T21:11:08.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f448b659-2cd0-4187-b0ee-5334c9e12560 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
110982024-12-13T21:11:08.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f448b659-2cd0-4187-b0ee-5334c9e12560 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
110992024-12-13T21:11:08.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111002024-12-13T21:11:08.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111012024-12-13T21:11:08.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111022024-12-13T21:11:08.004ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
111032024-12-13T21:11:08.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111042024-12-13T21:11:08.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "06f0d7af-3b8b-483c-aa36-b228759114d6", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
111052024-12-13T21:11:08.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111062024-12-13T21:11:08.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111072024-12-13T21:11:08.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f448b659-2cd0-4187-b0ee-5334c9e12560 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111082024-12-13T21:11:08.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111092024-12-13T21:11:08.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111102024-12-13T21:11:08.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111112024-12-13T21:11:08.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111122024-12-13T21:11:08.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111132024-12-13T21:11:08.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111142024-12-13T21:11:08.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111152024-12-13T21:11:08.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111162024-12-13T21:11:08.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111172024-12-13T21:11:08.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111182024-12-13T21:11:08.010ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: de87cd6b-76ad-49b5-80d8-1ecc50633f5a, rack_id: 96134c2d-377c-4f7c-9091-7f70a2919407, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(73c0b7a4-3215-460e-8b7f-89524471a8f1) } rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
111192024-12-13T21:11:08.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111202024-12-13T21:11:08.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111212024-12-13T21:11:08.013ZINFOnexus (BackgroundTasks): VPC route manager sled 82024834-9725-4304-9edd-af6b519041b3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
111222024-12-13T21:11:08.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111232024-12-13T21:11:08.014ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "43f623dc-4ded-4ddc-a669-ff9c68ebde7d", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
111242024-12-13T21:11:08.015ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.500692ms iteration = 30 status = {}
111252024-12-13T21:11:08.020ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
111262024-12-13T21:11:08.021ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "354d199d-1f02-4f04-9923-43a8691a04a4", "content-length": "134", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
111272024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
111282024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 73c0b7a4-3215-460e-8b7f-89524471a8f1
111292024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
111302024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
111312024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111322024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111332024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111342024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111352024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111362024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111372024-12-13T21:11:08.021ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407
111382024-12-13T21:11:08.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111392024-12-13T21:11:08.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111402024-12-13T21:11:08.024ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
111412024-12-13T21:11:08.024ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8819b906-9a0e-494d-b82a-103186941d16", "content-length": "2", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
111422024-12-13T21:11:08.024ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
111432024-12-13T21:11:08.024ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4f1e2ef-bd4f-48ce-9d45-1c10acf5f759", "content-length": "52", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
111442024-12-13T21:11:08.024ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch_location = Switch0
111452024-12-13T21:11:08.024ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
111462024-12-13T21:11:08.113ZDEBGnexus (BackgroundTasks): client request SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111472024-12-13T21:11:08.121ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a17216e9-d3bb-4a8f-b20a-4f280f035bc7", "date": "Fri, 13 Dec 2024 21:11:07 GMT"} })
111482024-12-13T21:11:08.121ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 switch = Switch0
111492024-12-13T21:11:08.121ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
111502024-12-13T21:11:08.121ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 96134c2d-377c-4f7c-9091-7f70a2919407 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cad8cfc-72b2-4865-819a-90d0ef571dcf", "content-length": "682", "date": "Fri, 13 Dec 2024 21:11:08 GMT"} })
111512024-12-13T21:11:08.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111522024-12-13T21:11:08.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111532024-12-13T21:11:08.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 82024834-9725-4304-9edd-af6b519041b3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e47a90d5-a595-43a7-91ee-470a4d7b9cc4", "content-length": "691", "date": "Fri, 13 Dec 2024 21:11:08 GMT"} })
111542024-12-13T21:11:08.122ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
111552024-12-13T21:11:08.122ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
111562024-12-13T21:11:08.122ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
111572024-12-13T21:11:08.122ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 400.615061ms iteration = 29 status = {}
111582024-12-13T21:11:08.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111592024-12-13T21:11:08.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111602024-12-13T21:11:08.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111612024-12-13T21:11:08.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111622024-12-13T21:11:08.131ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111632024-12-13T21:11:08.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111642024-12-13T21:11:08.139ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 417.037497ms iteration = 28 status = {}
111652024-12-13T21:11:09.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2b95b156-15bc-43eb-86c5-51f934cc897c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111662024-12-13T21:11:09.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2b95b156-15bc-43eb-86c5-51f934cc897c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111672024-12-13T21:11:09.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2b95b156-15bc-43eb-86c5-51f934cc897c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111682024-12-13T21:11:10.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2aae7725-4456-4c70-bce2-61f9c9084604 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111692024-12-13T21:11:10.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2aae7725-4456-4c70-bce2-61f9c9084604 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111702024-12-13T21:11:10.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2aae7725-4456-4c70-bce2-61f9c9084604 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111712024-12-13T21:11:11.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f18131c0-b876-4bd5-be33-27f1da3e28b6 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111722024-12-13T21:11:11.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f18131c0-b876-4bd5-be33-27f1da3e28b6 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111732024-12-13T21:11:11.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = f18131c0-b876-4bd5-be33-27f1da3e28b6 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111742024-12-13T21:11:12.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9755d456-a1f8-4c0c-b66e-d9ac1b4543e9 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111752024-12-13T21:11:12.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9755d456-a1f8-4c0c-b66e-d9ac1b4543e9 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111762024-12-13T21:11:12.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 9755d456-a1f8-4c0c-b66e-d9ac1b4543e9 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111772024-12-13T21:11:13.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e48e904-ef77-4420-be95-adeacdb3e0e2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111782024-12-13T21:11:13.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e48e904-ef77-4420-be95-adeacdb3e0e2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111792024-12-13T21:11:13.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 4e48e904-ef77-4420-be95-adeacdb3e0e2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111802024-12-13T21:11:14.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d00d10f-7392-4385-a275-7ff3554d5694 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111812024-12-13T21:11:14.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d00d10f-7392-4385-a275-7ff3554d5694 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111822024-12-13T21:11:14.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 8d00d10f-7392-4385-a275-7ff3554d5694 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111832024-12-13T21:11:15.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 849ea980-70ab-4d18-934b-5645d5f62025 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111842024-12-13T21:11:15.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 849ea980-70ab-4d18-934b-5645d5f62025 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111852024-12-13T21:11:15.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 849ea980-70ab-4d18-934b-5645d5f62025 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111862024-12-13T21:11:16.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7165bc39-db40-4c8d-8256-b8a541cafe0a roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111872024-12-13T21:11:16.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7165bc39-db40-4c8d-8256-b8a541cafe0a resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111882024-12-13T21:11:16.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 7165bc39-db40-4c8d-8256-b8a541cafe0a response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111892024-12-13T21:11:17.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed249616-e408-47ef-b40f-09ca9ac9f702 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111902024-12-13T21:11:17.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed249616-e408-47ef-b40f-09ca9ac9f702 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111912024-12-13T21:11:17.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ed249616-e408-47ef-b40f-09ca9ac9f702 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
111922024-12-13T21:11:17.663ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1515 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2808ada7-dc94-44fd-8b01-bf44f54c2412 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
111932024-12-13T21:11:17.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
111942024-12-13T21:11:17.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111952024-12-13T21:11:17.721ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
111962024-12-13T21:11:17.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111972024-12-13T21:11:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111982024-12-13T21:11:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111992024-12-13T21:11:17.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112002024-12-13T21:11:17.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112012024-12-13T21:11:17.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112022024-12-13T21:11:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112032024-12-13T21:11:17.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112042024-12-13T21:11:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112052024-12-13T21:11:17.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112062024-12-13T21:11:17.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112072024-12-13T21:11:17.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.161203ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112082024-12-13T21:11:17.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112092024-12-13T21:11:17.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
112102024-12-13T21:11:17.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112112024-12-13T21:11:17.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112122024-12-13T21:11:17.804ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
112132024-12-13T21:11:17.804ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.711556ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
112142024-12-13T21:11:18.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3c266e9-f8b6-4429-aa91-80560c7b4658 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112152024-12-13T21:11:18.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3c266e9-f8b6-4429-aa91-80560c7b4658 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112162024-12-13T21:11:18.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c3c266e9-f8b6-4429-aa91-80560c7b4658 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112172024-12-13T21:11:18.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 292d3182-e8d8-459a-afa3-21954111131a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
112182024-12-13T21:11:18.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 292d3182-e8d8-459a-afa3-21954111131a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
112192024-12-13T21:11:18.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48790 req_id = 292d3182-e8d8-459a-afa3-21954111131a response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
112202024-12-13T21:11:19.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b01df3a8-849b-43bd-bc44-d0f5858abb04 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112212024-12-13T21:11:19.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b01df3a8-849b-43bd-bc44-d0f5858abb04 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112222024-12-13T21:11:19.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b01df3a8-849b-43bd-bc44-d0f5858abb04 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112232024-12-13T21:11:20.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c30e0274-6fad-4e29-97c0-b9858c16669e roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112242024-12-13T21:11:20.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c30e0274-6fad-4e29-97c0-b9858c16669e resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112252024-12-13T21:11:20.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = c30e0274-6fad-4e29-97c0-b9858c16669e response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112262024-12-13T21:11:21.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e1642d7-07b1-48a1-96c4-6ee8a2a7524f roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112272024-12-13T21:11:21.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e1642d7-07b1-48a1-96c4-6ee8a2a7524f resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112282024-12-13T21:11:21.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 0e1642d7-07b1-48a1-96c4-6ee8a2a7524f response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112292024-12-13T21:11:22.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa927228-16f0-4937-bfba-3162f6a6224d roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112302024-12-13T21:11:22.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa927228-16f0-4937-bfba-3162f6a6224d resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112312024-12-13T21:11:22.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = aa927228-16f0-4937-bfba-3162f6a6224d response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112322024-12-13T21:11:23.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3225d1ff-f72f-41be-9727-71bba66e53a8 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112332024-12-13T21:11:23.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3225d1ff-f72f-41be-9727-71bba66e53a8 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112342024-12-13T21:11:23.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 3225d1ff-f72f-41be-9727-71bba66e53a8 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112352024-12-13T21:11:24.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bdf1e030-b758-476c-909b-5aa36671407b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112362024-12-13T21:11:24.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bdf1e030-b758-476c-909b-5aa36671407b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112372024-12-13T21:11:24.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bdf1e030-b758-476c-909b-5aa36671407b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112382024-12-13T21:11:25.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb0e4df8-a446-4b9d-96e4-265db7fcd2dd roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112392024-12-13T21:11:25.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb0e4df8-a446-4b9d-96e4-265db7fcd2dd resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112402024-12-13T21:11:25.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = bb0e4df8-a446-4b9d-96e4-265db7fcd2dd response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112412024-12-13T21:11:26.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6d18c3cf-c3ee-46bd-ad14-ce7b364e57bc roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112422024-12-13T21:11:26.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6d18c3cf-c3ee-46bd-ad14-ce7b364e57bc resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112432024-12-13T21:11:26.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 6d18c3cf-c3ee-46bd-ad14-ce7b364e57bc response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112442024-12-13T21:11:27.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02f3d464-4854-4dc9-b79c-e87ff7b0c8c4 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112452024-12-13T21:11:27.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02f3d464-4854-4dc9-b79c-e87ff7b0c8c4 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112462024-12-13T21:11:27.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 02f3d464-4854-4dc9-b79c-e87ff7b0c8c4 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112472024-12-13T21:11:27.662ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1226 local_addr = [fd00:1122:3344:101::c]:46552 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2d96ba42-1f98-4201-ad0e-5d8c024e44b4 response_code = 200 uri = /0599e804-8800-4951-9d87-7a8a49a507a3
112482024-12-13T21:11:27.721ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
112492024-12-13T21:11:27.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112502024-12-13T21:11:27.721ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
112512024-12-13T21:11:27.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112522024-12-13T21:11:27.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112532024-12-13T21:11:27.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112542024-12-13T21:11:27.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112552024-12-13T21:11:27.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112562024-12-13T21:11:27.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112572024-12-13T21:11:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112582024-12-13T21:11:27.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112592024-12-13T21:11:27.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112602024-12-13T21:11:27.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112612024-12-13T21:11:27.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112622024-12-13T21:11:27.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112632024-12-13T21:11:27.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 222ce3e5-4792-415c-8e0c-7bf71f7a9b69, lookup_type: ById(222ce3e5-4792-415c-8e0c-7bf71f7a9b69) } result = Ok(())
112642024-12-13T21:11:27.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112652024-12-13T21:11:27.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112662024-12-13T21:11:27.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 original_time_created = 2024-12-13 20:57:29.666278 UTC target_id = 222ce3e5-4792-415c-8e0c-7bf71f7a9b69 time_created = 2024-12-13 20:57:29.666278 UTC
112672024-12-13T21:11:27.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.999502ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"222ce3e5-4792-415c-8e0c-7bf71f7a9b69","time_created":"2024-12-13T20:57:29.666278Z"}
112682024-12-13T21:11:27.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.587229ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112692024-12-13T21:11:28.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 95f05342-f86c-49c0-8131-295ecffcf153 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112702024-12-13T21:11:28.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 95f05342-f86c-49c0-8131-295ecffcf153 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112712024-12-13T21:11:28.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 95f05342-f86c-49c0-8131-295ecffcf153 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112722024-12-13T21:11:29.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b2d08b47-8a06-4b88-a970-81886a3daed1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112732024-12-13T21:11:29.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b2d08b47-8a06-4b88-a970-81886a3daed1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112742024-12-13T21:11:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = b2d08b47-8a06-4b88-a970-81886a3daed1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112752024-12-13T21:11:30.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ecb36103-0ead-4d36-9bbb-2ce4d97afed2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112762024-12-13T21:11:30.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ecb36103-0ead-4d36-9bbb-2ce4d97afed2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112772024-12-13T21:11:30.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = ecb36103-0ead-4d36-9bbb-2ce4d97afed2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112782024-12-13T21:11:31.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f9ed5b1-bcf8-452f-9c5f-fb5b00cd074c roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112792024-12-13T21:11:31.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f9ed5b1-bcf8-452f-9c5f-fb5b00cd074c resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112802024-12-13T21:11:31.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 2f9ed5b1-bcf8-452f-9c5f-fb5b00cd074c response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112812024-12-13T21:11:32.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1d8f2617-da36-43a4-97d6-8cf2517bb9c2 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112822024-12-13T21:11:32.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1d8f2617-da36-43a4-97d6-8cf2517bb9c2 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112832024-12-13T21:11:32.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 1d8f2617-da36-43a4-97d6-8cf2517bb9c2 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112842024-12-13T21:11:33.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 12950230-1926-456b-8aff-f73df78cd5e1 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112852024-12-13T21:11:33.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 12950230-1926-456b-8aff-f73df78cd5e1 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112862024-12-13T21:11:33.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 12950230-1926-456b-8aff-f73df78cd5e1 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112872024-12-13T21:11:34.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde113d3-ae07-4a91-9c29-1270b0d48757 roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112882024-12-13T21:11:34.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde113d3-ae07-4a91-9c29-1270b0d48757 resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112892024-12-13T21:11:34.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = cde113d3-ae07-4a91-9c29-1270b0d48757 response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112902024-12-13T21:11:35.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 114de241-c3cc-44c0-b300-530a0c07f30b roles = RoleSet { roles: {} } uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112912024-12-13T21:11:35.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 114de241-c3cc-44c0-b300-530a0c07f30b resource = Database result = Ok(()) uri = /probes/82024834-9725-4304-9edd-af6b519041b3
112922024-12-13T21:11:35.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:60299 req_id = 114de241-c3cc-44c0-b300-530a0c07f30b response_code = 200 uri = /probes/82024834-9725-4304-9edd-af6b519041b3