Max level shown:
12024-11-14T09:00:00.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef4f1435-6c26-419c-b2d9-db1a8bd8172d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22024-11-14T09:00:00.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef4f1435-6c26-419c-b2d9-db1a8bd8172d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32024-11-14T09:00:00.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef4f1435-6c26-419c-b2d9-db1a8bd8172d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42024-11-14T09:00:01.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ee16032-7420-4357-af94-dd1d8efeeeb5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52024-11-14T09:00:01.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ee16032-7420-4357-af94-dd1d8efeeeb5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62024-11-14T09:00:01.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ee16032-7420-4357-af94-dd1d8efeeeb5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
72024-11-14T09:00:02.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6204a448-8ddb-489b-b469-d16ec407a13f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82024-11-14T09:00:02.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6204a448-8ddb-489b-b469-d16ec407a13f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
92024-11-14T09:00:02.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6204a448-8ddb-489b-b469-d16ec407a13f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
102024-11-14T09:00:03.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e80fd65c-80ad-4397-b09a-626dd12df15c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112024-11-14T09:00:03.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e80fd65c-80ad-4397-b09a-626dd12df15c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122024-11-14T09:00:03.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e80fd65c-80ad-4397-b09a-626dd12df15c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132024-11-14T09:00:04.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66735065-fdae-4424-8e0d-85731ec73b18 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142024-11-14T09:00:04.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66735065-fdae-4424-8e0d-85731ec73b18 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
152024-11-14T09:00:04.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66735065-fdae-4424-8e0d-85731ec73b18 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
162024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
172024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
182024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
192024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
202024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
212024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
222024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
232024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
242024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
252024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
262024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
272024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
282024-11-14T09:00:05.530ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
292024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
302024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.96\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
312024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
322024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
332024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
342024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
352024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
362024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
372024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
382024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
392024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
402024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
412024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
422024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
432024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
442024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
452024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
462024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
472024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
482024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
492024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
502024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
512024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
522024-11-14T09:00:05.530ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
532024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
542024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
552024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
562024-11-14T09:00:05.530ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:50:05.530622393 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
572024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
582024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
592024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
602024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
612024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
622024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
632024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
642024-11-14T09:00:05.530ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
652024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
662024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
672024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
682024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
692024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
702024-11-14T09:00:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
712024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
722024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
732024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
742024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
752024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
762024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
772024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
782024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
792024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
802024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
812024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
822024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
832024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
842024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
852024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
862024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
872024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
882024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
892024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
902024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
912024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
922024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
932024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
942024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
952024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
962024-11-14T09:00:05.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 318630881 } })
972024-11-14T09:00:05.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 318632651 } })
982024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
992024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1002024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1012024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1022024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1032024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1042024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1052024-11-14T09:00:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.476974ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1062024-11-14T09:00:05.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1072024-11-14T09:00:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.450274ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1082024-11-14T09:00:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1092024-11-14T09:00:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1102024-11-14T09:00:05.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1112024-11-14T09:00:05.534ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.944403ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1122024-11-14T09:00:05.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1132024-11-14T09:00:05.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1142024-11-14T09:00:05.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1152024-11-14T09:00:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1162024-11-14T09:00:05.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1172024-11-14T09:00:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1182024-11-14T09:00:05.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 324649148 } })
1192024-11-14T09:00:05.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
1202024-11-14T09:00:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1212024-11-14T09:00:05.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1222024-11-14T09:00:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1232024-11-14T09:00:05.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1242024-11-14T09:00:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1252024-11-14T09:00:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1262024-11-14T09:00:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1272024-11-14T09:00:05.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1282024-11-14T09:00:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1292024-11-14T09:00:05.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1302024-11-14T09:00:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1312024-11-14T09:00:05.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1322024-11-14T09:00:05.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1332024-11-14T09:00:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1342024-11-14T09:00:05.543ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:50:05.530622393 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1352024-11-14T09:00:05.543ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.859606ms iteration = 3 status = {"expiration":"2024-11-14T08:50:05.530622393Z","pruned":[]}
1362024-11-14T09:00:05.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1372024-11-14T09:00:05.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1382024-11-14T09:00:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1392024-11-14T09:00:05.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1402024-11-14T09:00:05.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1412024-11-14T09:00:05.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1422024-11-14T09:00:05.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 336663821 } })
1432024-11-14T09:00:05.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
1442024-11-14T09:00:05.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1452024-11-14T09:00:05.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1462024-11-14T09:00:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1472024-11-14T09:00:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1482024-11-14T09:00:05.550ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1492024-11-14T09:00:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1502024-11-14T09:00:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1512024-11-14T09:00:05.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1522024-11-14T09:00:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1532024-11-14T09:00:05.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 22.077424ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
1542024-11-14T09:00:05.553ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.42459ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
1552024-11-14T09:00:05.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.638906ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1562024-11-14T09:00:05.559ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 346986097 } })
1572024-11-14T09:00:05.560ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
1582024-11-14T09:00:05.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592024-11-14T09:00:05.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1602024-11-14T09:00:05.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1612024-11-14T09:00:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1622024-11-14T09:00:05.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1632024-11-14T09:00:05.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1642024-11-14T09:00:05.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1652024-11-14T09:00:05.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1662024-11-14T09:00:05.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1672024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1682024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1692024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1702024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1712024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1722024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1732024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1742024-11-14T09:00:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1752024-11-14T09:00:05.568ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
1762024-11-14T09:00:05.568ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
1772024-11-14T09:00:05.568ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
1782024-11-14T09:00:05.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1792024-11-14T09:00:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1802024-11-14T09:00:05.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1812024-11-14T09:00:05.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1822024-11-14T09:00:05.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1832024-11-14T09:00:05.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-11-14T09:00:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1852024-11-14T09:00:05.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1862024-11-14T09:00:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1872024-11-14T09:00:05.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1882024-11-14T09:00:05.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1892024-11-14T09:00:05.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1902024-11-14T09:00:05.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1912024-11-14T09:00:05.591ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1922024-11-14T09:00:05.591ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1932024-11-14T09:00:05.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1942024-11-14T09:00:05.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1952024-11-14T09:00:05.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1962024-11-14T09:00:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1972024-11-14T09:00:05.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1982024-11-14T09:00:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1992024-11-14T09:00:05.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-11-14T09:00:05.603ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2012024-11-14T09:00:05.603ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2022024-11-14T09:00:05.603ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.533476ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2032024-11-14T09:00:05.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.951938ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
2042024-11-14T09:00:05.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2052024-11-14T09:00:05.606ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2062024-11-14T09:00:05.606ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2072024-11-14T09:00:05.606ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.336936ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2082024-11-14T09:00:05.607ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2092024-11-14T09:00:05.607ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2102024-11-14T09:00:05.607ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2112024-11-14T09:00:05.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2122024-11-14T09:00:05.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2132024-11-14T09:00:05.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2142024-11-14T09:00:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2152024-11-14T09:00:05.612ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2162024-11-14T09:00:05.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.614337ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2172024-11-14T09:00:05.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2182024-11-14T09:00:05.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2192024-11-14T09:00:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2202024-11-14T09:00:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
2212024-11-14T09:00:05.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2222024-11-14T09:00:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2232024-11-14T09:00:05.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0f62d260-59a8-4da4-b708-fec29d6a9a88 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
2242024-11-14T09:00:05.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0f62d260-59a8-4da4-b708-fec29d6a9a88 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
2252024-11-14T09:00:05.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2262024-11-14T09:00:05.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2272024-11-14T09:00:05.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
2282024-11-14T09:00:05.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2292024-11-14T09:00:05.714ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba14c143-4716-41b5-80d8-9363aa3242fa", "content-length": "26", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
2302024-11-14T09:00:05.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2312024-11-14T09:00:05.715ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
2322024-11-14T09:00:05.715ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2332024-11-14T09:00:05.715ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2342024-11-14T09:00:05.716ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b37893cc-807d-4803-91f2-8b049db7660f", "content-length": "26", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
2352024-11-14T09:00:05.716ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2362024-11-14T09:00:05.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
2372024-11-14T09:00:05.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2382024-11-14T09:00:05.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2392024-11-14T09:00:05.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
2402024-11-14T09:00:05.735ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2412024-11-14T09:00:05.735ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bccc41f-99dd-40df-87f0-43020aa0d7a9", "content-length": "26", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
2422024-11-14T09:00:05.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2432024-11-14T09:00:05.737ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2442024-11-14T09:00:05.763ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2452024-11-14T09:00:05.763ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2462024-11-14T09:00:05.763ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d70be2ff-934f-4866-ab0d-f2fe3fc9191a", "content-length": "372", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
2472024-11-14T09:00:05.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2482024-11-14T09:00:05.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2492024-11-14T09:00:05.766ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2502024-11-14T09:00:05.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2512024-11-14T09:00:05.767ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
2522024-11-14T09:00:05.767ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
2532024-11-14T09:00:05.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2542024-11-14T09:00:05.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2552024-11-14T09:00:05.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2562024-11-14T09:00:05.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2572024-11-14T09:00:05.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582024-11-14T09:00:05.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 238.344119ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2592024-11-14T09:00:05.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0f62d260-59a8-4da4-b708-fec29d6a9a88 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
2602024-11-14T09:00:05.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2612024-11-14T09:00:05.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2622024-11-14T09:00:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2632024-11-14T09:00:05.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2642024-11-14T09:00:05.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2652024-11-14T09:00:05.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662024-11-14T09:00:05.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2672024-11-14T09:00:05.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2682024-11-14T09:00:05.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2692024-11-14T09:00:05.798ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
2702024-11-14T09:00:05.798ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 268.435882ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
2712024-11-14T09:00:05.810ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2722024-11-14T09:00:05.810ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2732024-11-14T09:00:05.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2742024-11-14T09:00:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2752024-11-14T09:00:05.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2762024-11-14T09:00:05.815ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
2772024-11-14T09:00:05.815ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
2782024-11-14T09:00:05.815ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
2792024-11-14T09:00:05.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 284.625143ms iteration = 4 status = {"generation":2}
2802024-11-14T09:00:05.829ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2812024-11-14T09:00:05.829ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2822024-11-14T09:00:05.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2832024-11-14T09:00:05.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2842024-11-14T09:00:05.831ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852024-11-14T09:00:05.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 300.333516ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2862024-11-14T09:00:05.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2872024-11-14T09:00:05.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 303.13735ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2882024-11-14T09:00:05.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2892024-11-14T09:00:05.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2902024-11-14T09:00:05.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2912024-11-14T09:00:05.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2922024-11-14T09:00:05.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2932024-11-14T09:00:05.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2942024-11-14T09:00:05.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952024-11-14T09:00:05.838ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
2962024-11-14T09:00:05.838ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
2972024-11-14T09:00:05.838ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
2982024-11-14T09:00:05.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 308.274623ms iteration = 4 status = {"generation":1}
2992024-11-14T09:00:05.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3002024-11-14T09:00:05.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3012024-11-14T09:00:05.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3022024-11-14T09:00:05.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3032024-11-14T09:00:05.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
3042024-11-14T09:00:05.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3052024-11-14T09:00:05.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3062024-11-14T09:00:05.850ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3072024-11-14T09:00:05.850ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3082024-11-14T09:00:05.850ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "993eb2a0-d152-44b1-9d2e-77a5521ddbed", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
3092024-11-14T09:00:05.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3102024-11-14T09:00:05.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3112024-11-14T09:00:05.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 322.221947ms iteration = 5 status = 0
3122024-11-14T09:00:05.852ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3132024-11-14T09:00:05.853ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3142024-11-14T09:00:05.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 322.453661ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3152024-11-14T09:00:05.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3162024-11-14T09:00:05.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3172024-11-14T09:00:05.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3182024-11-14T09:00:05.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3192024-11-14T09:00:05.866ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3202024-11-14T09:00:05.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 335.546411ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3212024-11-14T09:00:05.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3222024-11-14T09:00:05.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3232024-11-14T09:00:05.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3242024-11-14T09:00:05.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3252024-11-14T09:00:05.884ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
3262024-11-14T09:00:05.884ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 353.742694ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3272024-11-14T09:00:05.890ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 359.481555ms iteration = 8 status = {"physical_disks_added":0}
3282024-11-14T09:00:05.896ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3292024-11-14T09:00:05.970ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3302024-11-14T09:00:05.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3312024-11-14T09:00:06.015ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f4217f19-b325-49ff-8918-86ee340e5563", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
3322024-11-14T09:00:06.017ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 486.647299ms iteration = 6 status = {}
3332024-11-14T09:00:06.057ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 526.985106ms iteration = 5 status = {}
3342024-11-14T09:00:06.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3352024-11-14T09:00:06.073ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb9a071e-96c7-45ba-a414-16236b6ee059", "content-length": "691", "date": "Thu, 14 Nov 2024 09:00:06 GMT"} })
3362024-11-14T09:00:06.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3372024-11-14T09:00:06.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3382024-11-14T09:00:06.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3392024-11-14T09:00:06.074ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 544.415906ms iteration = 5 status = {}
3402024-11-14T09:00:06.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 6218a4e1-7f2f-4fec-9965-f8091527587a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3412024-11-14T09:00:06.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 6218a4e1-7f2f-4fec-9965-f8091527587a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3422024-11-14T09:00:06.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 6218a4e1-7f2f-4fec-9965-f8091527587a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3432024-11-14T09:00:06.133ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3442024-11-14T09:00:06.133ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9175094e-f64a-4ed5-a3b3-aeed9a262b64", "content-length": "1", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
3452024-11-14T09:00:06.135ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3462024-11-14T09:00:06.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3472024-11-14T09:00:06.137ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 607.349317ms iteration = 5 status = null
3482024-11-14T09:00:06.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3492024-11-14T09:00:06.164ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "39e38861-9434-4512-8ebb-9aa409327d2a", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3502024-11-14T09:00:06.164ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3512024-11-14T09:00:06.166ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "03970f3f-da51-4ba6-bcb4-ddb850b348a8", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3522024-11-14T09:00:06.166ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3532024-11-14T09:00:06.168ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3542024-11-14T09:00:06.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 638.079151ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3552024-11-14T09:00:06.182ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3562024-11-14T09:00:06.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3572024-11-14T09:00:06.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3582024-11-14T09:00:06.221ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
3592024-11-14T09:00:06.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3602024-11-14T09:00:06.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3612024-11-14T09:00:06.231ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3622024-11-14T09:00:06.231ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3632024-11-14T09:00:06.231ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e13019e-8af4-4735-b2ed-d97c492b12e0", "content-length": "134", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
3642024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3652024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
3662024-11-14T09:00:06.231ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "56624660-c536-41a9-b8d7-f0676c28c1b3", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3672024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3682024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3692024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3702024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3712024-11-14T09:00:06.231ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3722024-11-14T09:00:06.232ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3732024-11-14T09:00:06.232ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3742024-11-14T09:00:06.232ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3752024-11-14T09:00:06.232ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3762024-11-14T09:00:06.232ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
3772024-11-14T09:00:06.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3782024-11-14T09:00:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3792024-11-14T09:00:06.232ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1b121c65-0e81-4c7c-9f00-25d57f94febc", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3802024-11-14T09:00:06.232ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3812024-11-14T09:00:06.234ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7f536183-2871-414b-a9d1-3e166370d422", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3822024-11-14T09:00:06.234ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3832024-11-14T09:00:06.236ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3842024-11-14T09:00:06.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 705.526454ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3852024-11-14T09:00:06.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3862024-11-14T09:00:06.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5f180d9-f4c5-48d1-bde6-59ddabf18a46", "content-length": "2", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
3872024-11-14T09:00:06.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3882024-11-14T09:00:06.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "89fbf8d0-e951-4a3f-90da-e1750fbc2bde", "content-length": "52", "date": "Thu, 14 Nov 2024 09:00:05 GMT"} })
3892024-11-14T09:00:06.240ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
3902024-11-14T09:00:06.240ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3912024-11-14T09:00:06.333ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b88cb15f-92d6-4570-b378-7666454ce538", "date": "Thu, 14 Nov 2024 09:00:06 GMT"} })
3922024-11-14T09:00:06.333ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
3932024-11-14T09:00:06.333ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3942024-11-14T09:00:06.333ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8981e947-480e-4e69-ba3a-de94563eec9e", "content-length": "682", "date": "Thu, 14 Nov 2024 09:00:06 GMT"} })
3952024-11-14T09:00:06.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3962024-11-14T09:00:06.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3972024-11-14T09:00:06.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3982024-11-14T09:00:06.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3992024-11-14T09:00:06.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4002024-11-14T09:00:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4012024-11-14T09:00:06.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4022024-11-14T09:00:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4032024-11-14T09:00:06.367ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 836.966767ms iteration = 5 status = {}
4042024-11-14T09:00:06.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98354b02-06f4-49d6-853b-09d757506c69 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4052024-11-14T09:00:06.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98354b02-06f4-49d6-853b-09d757506c69 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4062024-11-14T09:00:06.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98354b02-06f4-49d6-853b-09d757506c69 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4072024-11-14T09:00:07.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 604fc765-52dc-484f-ad0d-9c3afee051da roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4082024-11-14T09:00:07.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 604fc765-52dc-484f-ad0d-9c3afee051da resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4092024-11-14T09:00:07.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 604fc765-52dc-484f-ad0d-9c3afee051da response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4102024-11-14T09:00:08.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 893364f1-33f7-4520-99d8-55e855b3deaf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4112024-11-14T09:00:08.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 893364f1-33f7-4520-99d8-55e855b3deaf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4122024-11-14T09:00:08.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 893364f1-33f7-4520-99d8-55e855b3deaf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4132024-11-14T09:00:09.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 49b837a9-047f-4a1a-88e0-3f9f18113065 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4142024-11-14T09:00:09.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 49b837a9-047f-4a1a-88e0-3f9f18113065 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4152024-11-14T09:00:09.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 49b837a9-047f-4a1a-88e0-3f9f18113065 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4162024-11-14T09:00:10.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9857dc50-c7fc-40e2-8268-11e61b77c5ef roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4172024-11-14T09:00:10.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9857dc50-c7fc-40e2-8268-11e61b77c5ef resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4182024-11-14T09:00:10.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9857dc50-c7fc-40e2-8268-11e61b77c5ef response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4192024-11-14T09:00:11.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ede4685-a809-4c74-b1df-7ccd80c214c8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4202024-11-14T09:00:11.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ede4685-a809-4c74-b1df-7ccd80c214c8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4212024-11-14T09:00:11.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ede4685-a809-4c74-b1df-7ccd80c214c8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4222024-11-14T09:00:12.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a90b689-6243-452a-838f-9dd40cd77096 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4232024-11-14T09:00:12.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a90b689-6243-452a-838f-9dd40cd77096 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4242024-11-14T09:00:12.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a90b689-6243-452a-838f-9dd40cd77096 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4252024-11-14T09:00:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c0c0429-6a18-409b-a5bc-b0e81192e13e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4262024-11-14T09:00:13.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c0c0429-6a18-409b-a5bc-b0e81192e13e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4272024-11-14T09:00:13.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c0c0429-6a18-409b-a5bc-b0e81192e13e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4282024-11-14T09:00:14.044ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1266 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = b41fd884-e623-4842-94ec-3ba1246b4e6d response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
4292024-11-14T09:00:14.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3af404f1-b56a-40f6-9b81-a950e01b0f35 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4302024-11-14T09:00:14.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3af404f1-b56a-40f6-9b81-a950e01b0f35 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4312024-11-14T09:00:14.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3af404f1-b56a-40f6-9b81-a950e01b0f35 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4322024-11-14T09:00:15.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
4332024-11-14T09:00:15.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
4342024-11-14T09:00:15.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4352024-11-14T09:00:15.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4362024-11-14T09:00:15.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4372024-11-14T09:00:15.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4382024-11-14T09:00:15.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4392024-11-14T09:00:15.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4402024-11-14T09:00:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4412024-11-14T09:00:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4422024-11-14T09:00:15.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4432024-11-14T09:00:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4442024-11-14T09:00:15.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4452024-11-14T09:00:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4462024-11-14T09:00:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4472024-11-14T09:00:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
4482024-11-14T09:00:15.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4492024-11-14T09:00:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4502024-11-14T09:00:15.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
4512024-11-14T09:00:15.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.973238ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
4522024-11-14T09:00:15.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.98244ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4532024-11-14T09:00:15.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3fc4d468-2549-49eb-ab56-b119f49c61fe roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4542024-11-14T09:00:15.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3fc4d468-2549-49eb-ab56-b119f49c61fe resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4552024-11-14T09:00:15.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3fc4d468-2549-49eb-ab56-b119f49c61fe response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4562024-11-14T09:00:17.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 34d32f4e-355d-40d1-930a-dd6bc868016e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4572024-11-14T09:00:17.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 34d32f4e-355d-40d1-930a-dd6bc868016e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4582024-11-14T09:00:17.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 34d32f4e-355d-40d1-930a-dd6bc868016e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4592024-11-14T09:00:18.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8537dd18-bc8c-494d-b688-8cd66d9c715a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4602024-11-14T09:00:18.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8537dd18-bc8c-494d-b688-8cd66d9c715a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4612024-11-14T09:00:18.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8537dd18-bc8c-494d-b688-8cd66d9c715a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4622024-11-14T09:00:19.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5cb5a91c-6515-435d-ae1e-a8dc3be9a403 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4632024-11-14T09:00:19.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5cb5a91c-6515-435d-ae1e-a8dc3be9a403 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4642024-11-14T09:00:19.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5cb5a91c-6515-435d-ae1e-a8dc3be9a403 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4652024-11-14T09:00:20.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7909e144-d4f0-4349-bf9c-4579361657df roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4662024-11-14T09:00:20.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7909e144-d4f0-4349-bf9c-4579361657df resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4672024-11-14T09:00:20.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7909e144-d4f0-4349-bf9c-4579361657df response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4682024-11-14T09:00:21.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 69a07f98-2f4a-4b3d-ae90-9a35d9f07415 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4692024-11-14T09:00:21.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 69a07f98-2f4a-4b3d-ae90-9a35d9f07415 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4702024-11-14T09:00:21.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 69a07f98-2f4a-4b3d-ae90-9a35d9f07415 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4712024-11-14T09:00:22.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 31c6746b-eaf4-4f37-8905-f3caac5b4e14 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4722024-11-14T09:00:22.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 31c6746b-eaf4-4f37-8905-f3caac5b4e14 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4732024-11-14T09:00:22.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 31c6746b-eaf4-4f37-8905-f3caac5b4e14 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4742024-11-14T09:00:23.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b9a28132-e9c5-45a8-9beb-a012064c601a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4752024-11-14T09:00:23.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b9a28132-e9c5-45a8-9beb-a012064c601a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4762024-11-14T09:00:23.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b9a28132-e9c5-45a8-9beb-a012064c601a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4772024-11-14T09:00:24.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8739f04e-583a-41ae-afd5-820360b94f7d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4782024-11-14T09:00:24.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8739f04e-583a-41ae-afd5-820360b94f7d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4792024-11-14T09:00:24.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8739f04e-583a-41ae-afd5-820360b94f7d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4802024-11-14T09:00:25.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3885dd14-0f2b-448c-973d-5dbf848ef204 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4812024-11-14T09:00:25.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3885dd14-0f2b-448c-973d-5dbf848ef204 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4822024-11-14T09:00:25.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3885dd14-0f2b-448c-973d-5dbf848ef204 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
4832024-11-14T09:00:25.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
4842024-11-14T09:00:25.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
4852024-11-14T09:00:25.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4862024-11-14T09:00:25.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4872024-11-14T09:00:25.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4882024-11-14T09:00:25.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4892024-11-14T09:00:25.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4902024-11-14T09:00:25.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4912024-11-14T09:00:25.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4922024-11-14T09:00:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4932024-11-14T09:00:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4942024-11-14T09:00:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4952024-11-14T09:00:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4962024-11-14T09:00:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4972024-11-14T09:00:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-11-14T09:00:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
4992024-11-14T09:00:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5002024-11-14T09:00:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5012024-11-14T09:00:25.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
5022024-11-14T09:00:25.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.378624ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
5032024-11-14T09:00:25.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.520159ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5042024-11-14T09:00:26.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e8503197-3d8a-4140-8028-216b18dcbb7c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5052024-11-14T09:00:26.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e8503197-3d8a-4140-8028-216b18dcbb7c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5062024-11-14T09:00:26.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e8503197-3d8a-4140-8028-216b18dcbb7c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5072024-11-14T09:00:27.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1063aed7-9378-4b90-a995-31e9f56ca9b6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5082024-11-14T09:00:27.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1063aed7-9378-4b90-a995-31e9f56ca9b6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5092024-11-14T09:00:27.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1063aed7-9378-4b90-a995-31e9f56ca9b6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5102024-11-14T09:00:28.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 699858c1-6491-4ee8-92a0-82bb3a7d5c3c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5112024-11-14T09:00:28.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 699858c1-6491-4ee8-92a0-82bb3a7d5c3c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5122024-11-14T09:00:28.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 699858c1-6491-4ee8-92a0-82bb3a7d5c3c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5132024-11-14T09:00:29.045ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 87f7e634-3c48-4480-9921-085025f49fd9 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
5142024-11-14T09:00:29.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0960bef5-78fa-43f1-9956-3cc14d74429d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5152024-11-14T09:00:29.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0960bef5-78fa-43f1-9956-3cc14d74429d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5162024-11-14T09:00:29.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0960bef5-78fa-43f1-9956-3cc14d74429d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5172024-11-14T09:00:30.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95972afd-8d0f-4b1f-b911-a4382a43b19f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5182024-11-14T09:00:30.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95972afd-8d0f-4b1f-b911-a4382a43b19f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5192024-11-14T09:00:30.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95972afd-8d0f-4b1f-b911-a4382a43b19f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5202024-11-14T09:00:31.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a8387418-25ad-4b77-b3ed-ae6d2602bd6d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5212024-11-14T09:00:31.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a8387418-25ad-4b77-b3ed-ae6d2602bd6d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5222024-11-14T09:00:31.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a8387418-25ad-4b77-b3ed-ae6d2602bd6d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5232024-11-14T09:00:32.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 839345c4-bd7b-4da0-8d15-3131b5fc1ee5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5242024-11-14T09:00:32.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 839345c4-bd7b-4da0-8d15-3131b5fc1ee5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5252024-11-14T09:00:32.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 839345c4-bd7b-4da0-8d15-3131b5fc1ee5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5262024-11-14T09:00:33.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 773e3324-dfde-49fc-a3d6-4968c27ae4b1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5272024-11-14T09:00:33.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 773e3324-dfde-49fc-a3d6-4968c27ae4b1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5282024-11-14T09:00:33.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 773e3324-dfde-49fc-a3d6-4968c27ae4b1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5292024-11-14T09:00:34.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9852e1d0-35a6-4329-bbac-fc2d38799210 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5302024-11-14T09:00:34.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9852e1d0-35a6-4329-bbac-fc2d38799210 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5312024-11-14T09:00:34.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9852e1d0-35a6-4329-bbac-fc2d38799210 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5322024-11-14T09:00:35.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a0b431a6-f9d5-46db-95e7-3376d60033df roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5332024-11-14T09:00:35.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a0b431a6-f9d5-46db-95e7-3376d60033df resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5342024-11-14T09:00:35.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a0b431a6-f9d5-46db-95e7-3376d60033df response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
5352024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
5362024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
5372024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5382024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
5392024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
5402024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
5412024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5422024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5432024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5442024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5452024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
5462024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5472024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
5482024-11-14T09:00:35.527ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5492024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5502024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
5512024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
5522024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5532024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
5542024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5552024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5562024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
5572024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
5582024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5592024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5602024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
5612024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5622024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5632024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5642024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5652024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5662024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5672024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5682024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5692024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5702024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5712024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5722024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5732024-11-14T09:00:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5742024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
5752024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
5762024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5772024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5782024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
5792024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5802024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
5812024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5822024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5832024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5842024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5852024-11-14T09:00:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5862024-11-14T09:00:35.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872024-11-14T09:00:35.529ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.772225ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5882024-11-14T09:00:35.530ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5892024-11-14T09:00:35.530ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5902024-11-14T09:00:35.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5912024-11-14T09:00:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5922024-11-14T09:00:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5932024-11-14T09:00:35.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5942024-11-14T09:00:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5952024-11-14T09:00:35.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5962024-11-14T09:00:35.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-11-14T09:00:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-11-14T09:00:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5992024-11-14T09:00:35.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6002024-11-14T09:00:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6012024-11-14T09:00:35.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6022024-11-14T09:00:35.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6032024-11-14T09:00:35.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 327448413 } })
6042024-11-14T09:00:35.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 327528394 } })
6052024-11-14T09:00:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6062024-11-14T09:00:35.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
6072024-11-14T09:00:35.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
6082024-11-14T09:00:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6092024-11-14T09:00:35.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6102024-11-14T09:00:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6112024-11-14T09:00:35.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-11-14T09:00:35.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.113508ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
6132024-11-14T09:00:35.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.873161ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
6142024-11-14T09:00:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6152024-11-14T09:00:35.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6162024-11-14T09:00:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6172024-11-14T09:00:35.542ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6182024-11-14T09:00:35.542ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6192024-11-14T09:00:35.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6202024-11-14T09:00:35.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6212024-11-14T09:00:35.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6222024-11-14T09:00:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6232024-11-14T09:00:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6242024-11-14T09:00:35.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6252024-11-14T09:00:35.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 334614528 } })
6262024-11-14T09:00:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6272024-11-14T09:00:35.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
6282024-11-14T09:00:35.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6292024-11-14T09:00:35.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6302024-11-14T09:00:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6312024-11-14T09:00:35.548ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6322024-11-14T09:00:35.548ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6332024-11-14T09:00:35.548ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 21.217351ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6342024-11-14T09:00:35.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6352024-11-14T09:00:35.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6362024-11-14T09:00:35.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6372024-11-14T09:00:35.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6382024-11-14T09:00:35.571ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6392024-11-14T09:00:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6402024-11-14T09:00:35.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6412024-11-14T09:00:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6422024-11-14T09:00:35.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6432024-11-14T09:00:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442024-11-14T09:00:35.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6452024-11-14T09:00:35.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6462024-11-14T09:00:35.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6472024-11-14T09:00:35.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6482024-11-14T09:00:35.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6492024-11-14T09:00:35.587ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6502024-11-14T09:00:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6512024-11-14T09:00:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6522024-11-14T09:00:35.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6532024-11-14T09:00:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6542024-11-14T09:00:35.591ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6552024-11-14T09:00:35.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.005798ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6562024-11-14T09:00:35.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6572024-11-14T09:00:35.627ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6582024-11-14T09:00:35.627ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41d7e9e3-e23a-4c70-a62b-834c4c03f195", "content-length": "26", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
6592024-11-14T09:00:35.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6602024-11-14T09:00:35.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6612024-11-14T09:00:35.630ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6622024-11-14T09:00:35.630ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6632024-11-14T09:00:35.631ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1c7d3d8-2be6-409c-807f-17da200e4d92", "content-length": "26", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
6642024-11-14T09:00:35.631ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6652024-11-14T09:00:35.633ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6662024-11-14T09:00:35.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
6672024-11-14T09:00:35.657ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6682024-11-14T09:00:35.658ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6692024-11-14T09:00:35.658ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6702024-11-14T09:00:35.658ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c24cc72c-2909-448d-8efe-6ebe0212fb38", "content-length": "26", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
6712024-11-14T09:00:35.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6722024-11-14T09:00:35.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6732024-11-14T09:00:35.658ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "16cdbbe5-248e-4174-8a12-86c3d33c86e4", "content-length": "372", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
6742024-11-14T09:00:35.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6752024-11-14T09:00:35.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6762024-11-14T09:00:35.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6772024-11-14T09:00:35.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
6782024-11-14T09:00:35.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792024-11-14T09:00:35.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6802024-11-14T09:00:35.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6812024-11-14T09:00:35.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
6822024-11-14T09:00:35.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6832024-11-14T09:00:35.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6842024-11-14T09:00:35.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6852024-11-14T09:00:35.670ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.013758ms iteration = 6 status = 0
6862024-11-14T09:00:35.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
6872024-11-14T09:00:35.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6882024-11-14T09:00:35.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6892024-11-14T09:00:35.684ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
6902024-11-14T09:00:35.684ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 157.217796ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
6912024-11-14T09:00:35.691ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6922024-11-14T09:00:35.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6932024-11-14T09:00:35.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 166.81665ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6942024-11-14T09:00:35.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 165.920266ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6952024-11-14T09:00:35.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 174.989701ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6962024-11-14T09:00:35.716ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
6972024-11-14T09:00:35.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
6982024-11-14T09:00:35.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 195.617283ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6992024-11-14T09:00:35.729ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.053667ms iteration = 6 status = {}
7002024-11-14T09:00:35.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7012024-11-14T09:00:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7022024-11-14T09:00:35.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7032024-11-14T09:00:35.775ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 247.636169ms iteration = 9 status = {"physical_disks_added":0}
7042024-11-14T09:00:35.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7052024-11-14T09:00:35.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7062024-11-14T09:00:35.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7072024-11-14T09:00:35.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-11-14T09:00:35.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7092024-11-14T09:00:35.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7102024-11-14T09:00:35.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7112024-11-14T09:00:35.788ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7122024-11-14T09:00:35.788ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "28e831e5-bdbf-466d-9e63-66c40621bc15", "content-length": "1", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7132024-11-14T09:00:35.790ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7142024-11-14T09:00:35.790ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e28d98c9-a560-4ae9-af47-0f035b9a9093", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7152024-11-14T09:00:35.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7162024-11-14T09:00:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7172024-11-14T09:00:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7182024-11-14T09:00:35.792ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.107299ms iteration = 6 status = null
7192024-11-14T09:00:35.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7202024-11-14T09:00:35.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7212024-11-14T09:00:35.871ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
7222024-11-14T09:00:35.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7232024-11-14T09:00:35.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7242024-11-14T09:00:35.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7252024-11-14T09:00:35.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5773ebae-9e97-4185-8f30-ace231df232a", "content-length": "691", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7262024-11-14T09:00:35.883ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7272024-11-14T09:00:35.883ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7282024-11-14T09:00:35.883ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7292024-11-14T09:00:35.885ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 357.806168ms iteration = 6 status = {}
7302024-11-14T09:00:35.892ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7312024-11-14T09:00:35.892ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d867d1d3-4362-4f19-9929-e57361ca7798", "content-length": "134", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7322024-11-14T09:00:35.892ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7332024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
7342024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7352024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7362024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7372024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7382024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7392024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7402024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7412024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7422024-11-14T09:00:35.893ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
7432024-11-14T09:00:35.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7442024-11-14T09:00:35.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7452024-11-14T09:00:35.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7462024-11-14T09:00:35.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "14ef55a2-e0fb-4909-8d68-27a4f546c14f", "content-length": "2", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7472024-11-14T09:00:35.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7482024-11-14T09:00:35.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "59fd60b8-9cce-4ae1-a5ab-8268e819ccb8", "content-length": "52", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7492024-11-14T09:00:35.895ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
7502024-11-14T09:00:35.895ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7512024-11-14T09:00:35.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7522024-11-14T09:00:35.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7532024-11-14T09:00:35.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542024-11-14T09:00:35.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552024-11-14T09:00:35.986ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c7267c2-f9b1-4ac2-94f2-16c01af0726a", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7562024-11-14T09:00:35.986ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
7572024-11-14T09:00:35.986ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7582024-11-14T09:00:35.986ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "25ceedbf-f10b-41ef-950f-5bfe967a0097", "content-length": "682", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7592024-11-14T09:00:35.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7602024-11-14T09:00:35.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7612024-11-14T09:00:35.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7622024-11-14T09:00:35.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7632024-11-14T09:00:35.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7642024-11-14T09:00:35.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7652024-11-14T09:00:35.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7662024-11-14T09:00:35.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7672024-11-14T09:00:36.003ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.234281ms iteration = 6 status = {}
7682024-11-14T09:00:36.009ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7692024-11-14T09:00:36.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7702024-11-14T09:00:36.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0bae8c7e-5126-41f8-af91-7172bfe536d6", "date": "Thu, 14 Nov 2024 09:00:35 GMT"} })
7712024-11-14T09:00:36.011ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 484.313401ms iteration = 7 status = {}
7722024-11-14T09:00:36.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3456aadb-8b7f-4aa0-9310-a431da6897ab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7732024-11-14T09:00:36.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3456aadb-8b7f-4aa0-9310-a431da6897ab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7742024-11-14T09:00:36.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3456aadb-8b7f-4aa0-9310-a431da6897ab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7752024-11-14T09:00:36.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48b4ab1f-f323-43fb-a5e3-2ddd48f3e4b3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7762024-11-14T09:00:36.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48b4ab1f-f323-43fb-a5e3-2ddd48f3e4b3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7772024-11-14T09:00:36.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48b4ab1f-f323-43fb-a5e3-2ddd48f3e4b3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7782024-11-14T09:00:37.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ffab53c-1437-44fc-9033-3270c4521243 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7792024-11-14T09:00:37.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ffab53c-1437-44fc-9033-3270c4521243 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7802024-11-14T09:00:37.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ffab53c-1437-44fc-9033-3270c4521243 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7812024-11-14T09:00:38.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a53288d-489b-4c3c-bbed-14f4095b3ea3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7822024-11-14T09:00:38.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a53288d-489b-4c3c-bbed-14f4095b3ea3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7832024-11-14T09:00:38.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a53288d-489b-4c3c-bbed-14f4095b3ea3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7842024-11-14T09:00:38.888ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46538
7852024-11-14T09:00:38.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46538 req_id = 88b1d3c7-2850-48ea-aaef-9c98284a155b roles = RoleSet { roles: {} } uri = /metrics/producers
7862024-11-14T09:00:38.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46538 req_id = 88b1d3c7-2850-48ea-aaef-9c98284a155b resource = Database result = Ok(()) uri = /metrics/producers
7872024-11-14T09:00:38.923ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 90e4e05f-b4bf-4b2e-9770-f73b3d2c05fa
7882024-11-14T09:00:38.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34942 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46538 req_id = 88b1d3c7-2850-48ea-aaef-9c98284a155b response_code = 201 uri = /metrics/producers
7892024-11-14T09:00:39.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a48b3228-5380-458d-991e-c2848ca5c1c6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7902024-11-14T09:00:39.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a48b3228-5380-458d-991e-c2848ca5c1c6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7912024-11-14T09:00:39.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a48b3228-5380-458d-991e-c2848ca5c1c6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7922024-11-14T09:00:39.539ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58970
7932024-11-14T09:00:39.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58970 req_id = e53440c0-d301-4df0-aeed-d4c9ef6178e5 roles = RoleSet { roles: {} } uri = /metrics/producers
7942024-11-14T09:00:39.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58970 req_id = e53440c0-d301-4df0-aeed-d4c9ef6178e5 resource = Database result = Ok(()) uri = /metrics/producers
7952024-11-14T09:00:39.642ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 0a0adcc5-bcdd-46d2-a222-ace3abfe409c
7962024-11-14T09:00:39.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102295 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58970 req_id = e53440c0-d301-4df0-aeed-d4c9ef6178e5 response_code = 201 uri = /metrics/producers
7972024-11-14T09:00:40.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb6eaa40-5f29-4f43-a5f9-7c2b5257fb81 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7982024-11-14T09:00:40.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb6eaa40-5f29-4f43-a5f9-7c2b5257fb81 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
7992024-11-14T09:00:40.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb6eaa40-5f29-4f43-a5f9-7c2b5257fb81 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8002024-11-14T09:00:41.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0d9b9f4b-c7a6-418b-b51f-4e911d7db13d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8012024-11-14T09:00:41.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0d9b9f4b-c7a6-418b-b51f-4e911d7db13d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8022024-11-14T09:00:41.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0d9b9f4b-c7a6-418b-b51f-4e911d7db13d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8032024-11-14T09:00:42.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a24a1e9-519c-4c65-a3c4-0a0672165e82 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8042024-11-14T09:00:42.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a24a1e9-519c-4c65-a3c4-0a0672165e82 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8052024-11-14T09:00:42.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a24a1e9-519c-4c65-a3c4-0a0672165e82 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8062024-11-14T09:00:43.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0b84f454-4aeb-4ac4-bf1b-1a94067ef733 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8072024-11-14T09:00:43.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0b84f454-4aeb-4ac4-bf1b-1a94067ef733 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8082024-11-14T09:00:43.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0b84f454-4aeb-4ac4-bf1b-1a94067ef733 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8092024-11-14T09:00:44.044ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1641 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 484391e9-df17-4002-ba86-594786b3d670 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
8102024-11-14T09:00:44.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f45d832-f337-43df-b08c-714c9ab8893b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8112024-11-14T09:00:44.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f45d832-f337-43df-b08c-714c9ab8893b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8122024-11-14T09:00:44.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f45d832-f337-43df-b08c-714c9ab8893b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8132024-11-14T09:00:45.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
8142024-11-14T09:00:45.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8152024-11-14T09:00:45.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
8162024-11-14T09:00:45.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8172024-11-14T09:00:45.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8182024-11-14T09:00:45.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8192024-11-14T09:00:45.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8202024-11-14T09:00:45.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8212024-11-14T09:00:45.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8222024-11-14T09:00:45.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8232024-11-14T09:00:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8242024-11-14T09:00:45.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8252024-11-14T09:00:45.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8262024-11-14T09:00:45.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8272024-11-14T09:00:45.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8282024-11-14T09:00:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
8292024-11-14T09:00:45.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8302024-11-14T09:00:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8312024-11-14T09:00:45.567ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57340
8322024-11-14T09:00:45.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57340 req_id = d329f2f6-d672-4d58-b5b8-f7750d350ddc roles = RoleSet { roles: {} } uri = /metrics/producers
8332024-11-14T09:00:45.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57340 req_id = d329f2f6-d672-4d58-b5b8-f7750d350ddc resource = Database result = Ok(()) uri = /metrics/producers
8342024-11-14T09:00:45.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
8352024-11-14T09:00:45.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.606793ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
8362024-11-14T09:00:45.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.867862ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8372024-11-14T09:00:45.604ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 4ceca43a-03cf-4e69-8d70-2c7628b44304
8382024-11-14T09:00:45.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36690 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57340 req_id = d329f2f6-d672-4d58-b5b8-f7750d350ddc response_code = 201 uri = /metrics/producers
8392024-11-14T09:00:45.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eac800cf-1792-4135-b1ea-270911908b34 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8402024-11-14T09:00:45.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eac800cf-1792-4135-b1ea-270911908b34 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8412024-11-14T09:00:45.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eac800cf-1792-4135-b1ea-270911908b34 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8422024-11-14T09:00:46.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 18e71e6a-8ca5-40a9-ae51-e59cae841a79 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8432024-11-14T09:00:46.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 18e71e6a-8ca5-40a9-ae51-e59cae841a79 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8442024-11-14T09:00:46.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 18e71e6a-8ca5-40a9-ae51-e59cae841a79 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8452024-11-14T09:00:47.053ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:35541
8462024-11-14T09:00:47.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35541 req_id = 27604d80-a4f4-4aec-9eae-8b618e78a56f roles = RoleSet { roles: {} } uri = /metrics/producers
8472024-11-14T09:00:47.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35541 req_id = 27604d80-a4f4-4aec-9eae-8b618e78a56f resource = Database result = Ok(()) uri = /metrics/producers
8482024-11-14T09:00:47.062ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 65d2236a-3110-4d84-aa25-77e21779db87
8492024-11-14T09:00:47.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8765 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35541 req_id = 27604d80-a4f4-4aec-9eae-8b618e78a56f response_code = 201 uri = /metrics/producers
8502024-11-14T09:00:47.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 355743ef-8df8-4823-b915-1bebf83d1485 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8512024-11-14T09:00:47.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 355743ef-8df8-4823-b915-1bebf83d1485 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8522024-11-14T09:00:47.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 355743ef-8df8-4823-b915-1bebf83d1485 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8532024-11-14T09:00:48.635ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43353
8542024-11-14T09:00:48.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43353 req_id = 54523334-a0d8-432f-a7c3-8b67ccd24ca4 roles = RoleSet { roles: {} } uri = /metrics/producers
8552024-11-14T09:00:48.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43353 req_id = 54523334-a0d8-432f-a7c3-8b67ccd24ca4 resource = Database result = Ok(()) uri = /metrics/producers
8562024-11-14T09:00:48.643ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 92786f50-3ada-49c6-9f91-967466d8804f
8572024-11-14T09:00:48.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7215 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43353 req_id = 54523334-a0d8-432f-a7c3-8b67ccd24ca4 response_code = 201 uri = /metrics/producers
8582024-11-14T09:00:48.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c820532-5a8b-4c91-a2bd-b3179334ecf4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8592024-11-14T09:00:48.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c820532-5a8b-4c91-a2bd-b3179334ecf4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8602024-11-14T09:00:48.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c820532-5a8b-4c91-a2bd-b3179334ecf4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8612024-11-14T09:00:49.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5f2859a9-0157-4b23-99c2-d1e11300de32 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8622024-11-14T09:00:49.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5f2859a9-0157-4b23-99c2-d1e11300de32 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8632024-11-14T09:00:49.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5f2859a9-0157-4b23-99c2-d1e11300de32 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8642024-11-14T09:00:50.686ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55695
8652024-11-14T09:00:50.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55695 req_id = c67452df-c0d6-43e7-b669-1c9eb34b7211 roles = RoleSet { roles: {} } uri = /metrics/producers
8662024-11-14T09:00:50.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55695 req_id = c67452df-c0d6-43e7-b669-1c9eb34b7211 resource = Database result = Ok(()) uri = /metrics/producers
8672024-11-14T09:00:50.695ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = c91f550b-068d-4077-a493-b226555a9b58
8682024-11-14T09:00:50.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9229 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55695 req_id = c67452df-c0d6-43e7-b669-1c9eb34b7211 response_code = 201 uri = /metrics/producers
8692024-11-14T09:00:50.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6fc5d056-e576-4bde-a257-dd12f9c7ca6d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8702024-11-14T09:00:50.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6fc5d056-e576-4bde-a257-dd12f9c7ca6d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8712024-11-14T09:00:50.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6fc5d056-e576-4bde-a257-dd12f9c7ca6d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8722024-11-14T09:00:51.042ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
8732024-11-14T09:00:51.042ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
8742024-11-14T09:00:51.072ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
8752024-11-14T09:00:51.073ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:53924
8762024-11-14T09:00:51.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53924 req_id = 86989f69-689e-43ad-a3b8-e45002571fa6 roles = RoleSet { roles: {} } uri = /metrics/producers
8772024-11-14T09:00:51.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53924 req_id = 86989f69-689e-43ad-a3b8-e45002571fa6 resource = Database result = Ok(()) uri = /metrics/producers
8782024-11-14T09:00:51.081ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 484a1c50-302f-49ec-9214-2179c2ff7104
8792024-11-14T09:00:51.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8756 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53924 req_id = 86989f69-689e-43ad-a3b8-e45002571fa6 response_code = 201 uri = /metrics/producers
8802024-11-14T09:00:51.081ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "86989f69-689e-43ad-a3b8-e45002571fa6", "content-length": "41", "date": "Thu, 14 Nov 2024 09:00:50 GMT"} })
8812024-11-14T09:00:51.084ZDEBGnexus (producer-registration-task): registered with nexus successfully
8822024-11-14T09:00:51.084ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
8832024-11-14T09:00:51.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b12c4bb-8c7c-46f8-8ebb-4610cd63c6fb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8842024-11-14T09:00:51.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b12c4bb-8c7c-46f8-8ebb-4610cd63c6fb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8852024-11-14T09:00:51.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b12c4bb-8c7c-46f8-8ebb-4610cd63c6fb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8862024-11-14T09:00:52.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d95483ed-c76b-4f6b-8885-0ea98be0e969 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8872024-11-14T09:00:52.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d95483ed-c76b-4f6b-8885-0ea98be0e969 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8882024-11-14T09:00:52.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d95483ed-c76b-4f6b-8885-0ea98be0e969 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8892024-11-14T09:00:53.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f5a4142-c4a7-4f15-9e40-9a87f82a0673 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8902024-11-14T09:00:53.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f5a4142-c4a7-4f15-9e40-9a87f82a0673 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8912024-11-14T09:00:53.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f5a4142-c4a7-4f15-9e40-9a87f82a0673 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8922024-11-14T09:00:54.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 24dc8bba-418d-4ed9-882d-74e436f722e0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8932024-11-14T09:00:54.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 24dc8bba-418d-4ed9-882d-74e436f722e0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8942024-11-14T09:00:54.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 24dc8bba-418d-4ed9-882d-74e436f722e0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
8952024-11-14T09:00:55.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
8962024-11-14T09:00:55.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
8972024-11-14T09:00:55.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8982024-11-14T09:00:55.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8992024-11-14T09:00:55.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-11-14T09:00:55.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9012024-11-14T09:00:55.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-11-14T09:00:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9032024-11-14T09:00:55.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9042024-11-14T09:00:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052024-11-14T09:00:55.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9062024-11-14T09:00:55.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9072024-11-14T09:00:55.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9082024-11-14T09:00:55.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9092024-11-14T09:00:55.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.604314ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9102024-11-14T09:00:55.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9112024-11-14T09:00:55.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
9122024-11-14T09:00:55.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9132024-11-14T09:00:55.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9142024-11-14T09:00:55.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
9152024-11-14T09:00:55.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.538091ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
9162024-11-14T09:00:55.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1422a0af-1690-4e95-8719-18448f459b2f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9172024-11-14T09:00:55.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1422a0af-1690-4e95-8719-18448f459b2f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9182024-11-14T09:00:55.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1422a0af-1690-4e95-8719-18448f459b2f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9192024-11-14T09:00:56.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f01acc52-0148-44e7-801d-b1f5aab3a935 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9202024-11-14T09:00:56.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f01acc52-0148-44e7-801d-b1f5aab3a935 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9212024-11-14T09:00:56.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f01acc52-0148-44e7-801d-b1f5aab3a935 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9222024-11-14T09:00:57.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a85d6c06-ca70-4033-9f78-9edc7cc627a7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9232024-11-14T09:00:57.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a85d6c06-ca70-4033-9f78-9edc7cc627a7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9242024-11-14T09:00:57.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a85d6c06-ca70-4033-9f78-9edc7cc627a7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9252024-11-14T09:00:58.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8ebc40bd-d0ca-47ef-bf12-b0c1b5a0a3c9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9262024-11-14T09:00:58.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8ebc40bd-d0ca-47ef-bf12-b0c1b5a0a3c9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9272024-11-14T09:00:58.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8ebc40bd-d0ca-47ef-bf12-b0c1b5a0a3c9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9282024-11-14T09:00:59.044ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = d09420d5-5a44-4038-b7e4-e8d3faa019ec response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
9292024-11-14T09:00:59.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 54ea1f44-249f-4573-9bd0-07e82c33ba4f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9302024-11-14T09:00:59.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 54ea1f44-249f-4573-9bd0-07e82c33ba4f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9312024-11-14T09:00:59.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 54ea1f44-249f-4573-9bd0-07e82c33ba4f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9322024-11-14T09:01:00.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6078eb67-97b8-402d-9fab-79fc2131da0d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9332024-11-14T09:01:00.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6078eb67-97b8-402d-9fab-79fc2131da0d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9342024-11-14T09:01:00.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6078eb67-97b8-402d-9fab-79fc2131da0d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9352024-11-14T09:01:01.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eed62788-339c-4760-b119-c0ce4eb266ae roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9362024-11-14T09:01:01.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eed62788-339c-4760-b119-c0ce4eb266ae resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9372024-11-14T09:01:01.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eed62788-339c-4760-b119-c0ce4eb266ae response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9382024-11-14T09:01:02.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7cc1ad86-9342-49d6-b3ef-e1cbaf330d74 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9392024-11-14T09:01:02.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7cc1ad86-9342-49d6-b3ef-e1cbaf330d74 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9402024-11-14T09:01:02.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7cc1ad86-9342-49d6-b3ef-e1cbaf330d74 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9412024-11-14T09:01:04.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6b77717e-d63b-4f59-a2c1-003427f4227e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9422024-11-14T09:01:04.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6b77717e-d63b-4f59-a2c1-003427f4227e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9432024-11-14T09:01:04.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6b77717e-d63b-4f59-a2c1-003427f4227e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9442024-11-14T09:01:04.036ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:44081
9452024-11-14T09:01:04.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b6c0970b-89c7-4590-b1cc-046786498ae2 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
9462024-11-14T09:01:04.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b6c0970b-89c7-4590-b1cc-046786498ae2 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
9472024-11-14T09:01:04.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b6c0970b-89c7-4590-b1cc-046786498ae2 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
9482024-11-14T09:01:04.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b358b1e9-399a-41f0-9124-2595f9faacf5 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
9492024-11-14T09:01:04.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b358b1e9-399a-41f0-9124-2595f9faacf5 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
9502024-11-14T09:01:04.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b358b1e9-399a-41f0-9124-2595f9faacf5 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
9512024-11-14T09:01:05.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8070b167-351b-4be7-95d0-f710dde47bb5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9522024-11-14T09:01:05.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8070b167-351b-4be7-95d0-f710dde47bb5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9532024-11-14T09:01:05.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8070b167-351b-4be7-95d0-f710dde47bb5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
9542024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
9552024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
9562024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9572024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
9582024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
9592024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9602024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9612024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
9622024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9632024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
9642024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9652024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
9662024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9672024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9682024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
9692024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
9702024-11-14T09:01:05.527ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
9712024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9722024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
9732024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9742024-11-14T09:01:05.527ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
9752024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
9762024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.27\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
9772024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9782024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
9792024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9802024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9812024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
9822024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
9832024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9842024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
9852024-11-14T09:01:05.527ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9862024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9872024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
9882024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9892024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
9902024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9912024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
9922024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9932024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
9942024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
9952024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
9962024-11-14T09:01:05.527ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:51:05.527691672 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
9972024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
9982024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
9992024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10002024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10012024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10022024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
10032024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10042024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
10052024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10062024-11-14T09:01:05.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10072024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10082024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10092024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10102024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10112024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10122024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10132024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10142024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10152024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10162024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10172024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10182024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10192024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10202024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10212024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10222024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10232024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10242024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10252024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
10262024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10272024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
10282024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10292024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10302024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
10312024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
10322024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10332024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10342024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
10352024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10362024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10372024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10382024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
10392024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10402024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10412024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10422024-11-14T09:01:05.528ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 318704012 } })
10432024-11-14T09:01:05.528ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 318733883 } })
10442024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10452024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10462024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10472024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10482024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10492024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10502024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10512024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10522024-11-14T09:01:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10532024-11-14T09:01:05.529ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
10542024-11-14T09:01:05.529ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.611756ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
10552024-11-14T09:01:05.529ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
10562024-11-14T09:01:05.529ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.606076ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
10572024-11-14T09:01:05.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582024-11-14T09:01:05.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10592024-11-14T09:01:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10602024-11-14T09:01:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.789827ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10612024-11-14T09:01:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10622024-11-14T09:01:05.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10632024-11-14T09:01:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10642024-11-14T09:01:05.536ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-11-14T09:01:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10662024-11-14T09:01:05.539ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10672024-11-14T09:01:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10682024-11-14T09:01:05.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10692024-11-14T09:01:05.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10702024-11-14T09:01:05.543ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10712024-11-14T09:01:05.543ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10722024-11-14T09:01:05.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10732024-11-14T09:01:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10742024-11-14T09:01:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10752024-11-14T09:01:05.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10762024-11-14T09:01:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10772024-11-14T09:01:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10782024-11-14T09:01:05.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10792024-11-14T09:01:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10802024-11-14T09:01:05.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 340962380 } })
10812024-11-14T09:01:05.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
10822024-11-14T09:01:05.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 341819514 } })
10832024-11-14T09:01:05.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10842024-11-14T09:01:05.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
10852024-11-14T09:01:05.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10862024-11-14T09:01:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10872024-11-14T09:01:05.553ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:51:05.527691672 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
10882024-11-14T09:01:05.553ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 26.15616ms iteration = 4 status = {"expiration":"2024-11-14T08:51:05.527691672Z","pruned":[]}
10892024-11-14T09:01:05.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10902024-11-14T09:01:05.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10912024-11-14T09:01:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10922024-11-14T09:01:05.566ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10932024-11-14T09:01:05.566ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 38.367507ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
10942024-11-14T09:01:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10952024-11-14T09:01:05.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10962024-11-14T09:01:05.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10972024-11-14T09:01:05.595ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10982024-11-14T09:01:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10992024-11-14T09:01:05.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11002024-11-14T09:01:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11012024-11-14T09:01:05.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11022024-11-14T09:01:05.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032024-11-14T09:01:05.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11042024-11-14T09:01:05.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11052024-11-14T09:01:05.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11062024-11-14T09:01:05.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11072024-11-14T09:01:05.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11082024-11-14T09:01:05.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11092024-11-14T09:01:05.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11102024-11-14T09:01:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11112024-11-14T09:01:05.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11122024-11-14T09:01:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11132024-11-14T09:01:05.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11142024-11-14T09:01:05.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 403420674 } })
11152024-11-14T09:01:05.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
11162024-11-14T09:01:05.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11172024-11-14T09:01:05.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11182024-11-14T09:01:05.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11192024-11-14T09:01:05.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-11-14T09:01:05.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212024-11-14T09:01:05.619ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11222024-11-14T09:01:05.619ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11232024-11-14T09:01:05.619ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 91.118344ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11242024-11-14T09:01:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11252024-11-14T09:01:05.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11262024-11-14T09:01:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11272024-11-14T09:01:05.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282024-11-14T09:01:05.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-11-14T09:01:05.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11302024-11-14T09:01:05.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 94.091052ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
11312024-11-14T09:01:05.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11322024-11-14T09:01:05.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11332024-11-14T09:01:05.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 95.143388ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
11342024-11-14T09:01:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11352024-11-14T09:01:05.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11362024-11-14T09:01:05.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-11-14T09:01:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11382024-11-14T09:01:05.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11392024-11-14T09:01:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11402024-11-14T09:01:05.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11412024-11-14T09:01:05.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11422024-11-14T09:01:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11432024-11-14T09:01:05.627ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11442024-11-14T09:01:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11452024-11-14T09:01:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11462024-11-14T09:01:05.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11472024-11-14T09:01:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11482024-11-14T09:01:05.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11492024-11-14T09:01:05.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11502024-11-14T09:01:05.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11512024-11-14T09:01:05.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11522024-11-14T09:01:05.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11532024-11-14T09:01:05.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11542024-11-14T09:01:05.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11552024-11-14T09:01:05.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11562024-11-14T09:01:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11572024-11-14T09:01:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11582024-11-14T09:01:05.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11592024-11-14T09:01:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11602024-11-14T09:01:05.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612024-11-14T09:01:05.639ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 112.411126ms iteration = 3 status = {"nsuccess":5}
11622024-11-14T09:01:05.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632024-11-14T09:01:05.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11642024-11-14T09:01:05.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11652024-11-14T09:01:05.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11662024-11-14T09:01:05.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
11672024-11-14T09:01:05.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11682024-11-14T09:01:05.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11692024-11-14T09:01:05.647ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
11702024-11-14T09:01:05.651ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11712024-11-14T09:01:05.651ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11722024-11-14T09:01:05.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11732024-11-14T09:01:05.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11742024-11-14T09:01:05.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11752024-11-14T09:01:05.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11762024-11-14T09:01:05.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11772024-11-14T09:01:05.657ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11782024-11-14T09:01:05.657ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11792024-11-14T09:01:05.657ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 130.07716ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11802024-11-14T09:01:05.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11812024-11-14T09:01:05.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11822024-11-14T09:01:05.670ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
11832024-11-14T09:01:05.670ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
11842024-11-14T09:01:05.670ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
11852024-11-14T09:01:05.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11862024-11-14T09:01:05.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11872024-11-14T09:01:05.674ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11882024-11-14T09:01:05.674ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11892024-11-14T09:01:05.674ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11902024-11-14T09:01:05.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11912024-11-14T09:01:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11922024-11-14T09:01:05.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 149.861348ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11932024-11-14T09:01:05.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.137692ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11942024-11-14T09:01:05.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 150.63974ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11952024-11-14T09:01:05.681ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11962024-11-14T09:01:05.681ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 154.229258ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11972024-11-14T09:01:05.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11982024-11-14T09:01:05.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11992024-11-14T09:01:05.712ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12002024-11-14T09:01:05.712ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12012024-11-14T09:01:05.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23b011d2-b5ac-4192-9c2f-dd81dedfc504", "content-length": "26", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
12022024-11-14T09:01:05.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12032024-11-14T09:01:05.714ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12042024-11-14T09:01:05.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12052024-11-14T09:01:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12062024-11-14T09:01:05.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12072024-11-14T09:01:05.741ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12082024-11-14T09:01:05.741ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "666e5aa8-18e1-46c6-802c-4b67bdb59c1b", "content-length": "26", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
12092024-11-14T09:01:05.741ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12102024-11-14T09:01:05.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12112024-11-14T09:01:05.755ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.723469ms iteration = 10 status = {"physical_disks_added":0}
12122024-11-14T09:01:05.791ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
12132024-11-14T09:01:05.791ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12142024-11-14T09:01:05.791ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df4dc8dc-f207-4f11-bb85-f97c48065862", "content-length": "26", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
12152024-11-14T09:01:05.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12162024-11-14T09:01:05.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
12172024-11-14T09:01:05.812ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12182024-11-14T09:01:05.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12192024-11-14T09:01:05.814ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a7225f1d-42dc-4f0b-97d4-0054327734d9", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12202024-11-14T09:01:05.814ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12212024-11-14T09:01:05.816ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0995e4c3-5cd0-4382-965d-0fc640984ebd", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12222024-11-14T09:01:05.816ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12232024-11-14T09:01:05.817ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12242024-11-14T09:01:05.817ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 290.150232ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
12252024-11-14T09:01:05.875ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12262024-11-14T09:01:05.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12272024-11-14T09:01:05.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12282024-11-14T09:01:05.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12292024-11-14T09:01:05.884ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.297951ms iteration = 7 status = {}
12302024-11-14T09:01:05.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
12312024-11-14T09:01:05.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 361.584459ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
12322024-11-14T09:01:05.890ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12332024-11-14T09:01:05.891ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6993e7d0-9638-45fd-a495-1f04fffb5681", "content-length": "1", "date": "Thu, 14 Nov 2024 09:01:04 GMT"} })
12342024-11-14T09:01:05.893ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12352024-11-14T09:01:05.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12362024-11-14T09:01:05.897ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 369.421255ms iteration = 7 status = null
12372024-11-14T09:01:05.914ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12382024-11-14T09:01:05.915ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12392024-11-14T09:01:05.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 387.458466ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12402024-11-14T09:01:05.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412024-11-14T09:01:05.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12422024-11-14T09:01:05.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12432024-11-14T09:01:05.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12442024-11-14T09:01:05.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 391.624242ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12452024-11-14T09:01:05.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12462024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
12472024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12482024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12492024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12502024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12512024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12522024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "21048f10-50a6-44f2-9cc4-5d2e9797be5e", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12532024-11-14T09:01:05.921ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12542024-11-14T09:01:05.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12552024-11-14T09:01:05.922ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 395.545815ms iteration = 7 status = 0
12562024-11-14T09:01:05.923ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "30d68a53-02b7-4e38-87f1-e086f4dc1e44", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12572024-11-14T09:01:05.923ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12582024-11-14T09:01:05.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12592024-11-14T09:01:05.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12602024-11-14T09:01:05.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12612024-11-14T09:01:05.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ca4a0262-2376-4252-b8bc-b4b2c18d482d", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12622024-11-14T09:01:05.924ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12632024-11-14T09:01:05.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0901f6b-f512-41d5-a48c-c522d3683c3b", "content-length": "372", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
12642024-11-14T09:01:05.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12652024-11-14T09:01:05.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12662024-11-14T09:01:05.926ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12672024-11-14T09:01:05.926ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 399.084572ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
12682024-11-14T09:01:05.952ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12692024-11-14T09:01:05.952ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12702024-11-14T09:01:05.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12712024-11-14T09:01:05.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12722024-11-14T09:01:05.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12732024-11-14T09:01:05.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742024-11-14T09:01:05.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12752024-11-14T09:01:05.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12762024-11-14T09:01:05.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12772024-11-14T09:01:05.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12782024-11-14T09:01:05.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12792024-11-14T09:01:05.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12802024-11-14T09:01:05.960ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12812024-11-14T09:01:05.960ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
12822024-11-14T09:01:05.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12832024-11-14T09:01:05.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12842024-11-14T09:01:05.961ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
12852024-11-14T09:01:05.961ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12862024-11-14T09:01:05.961ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
12872024-11-14T09:01:05.961ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 433.665077ms iteration = 5 status = {"generation":1}
12882024-11-14T09:01:05.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892024-11-14T09:01:05.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12902024-11-14T09:01:05.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12912024-11-14T09:01:05.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12922024-11-14T09:01:05.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
12932024-11-14T09:01:05.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12942024-11-14T09:01:05.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
12952024-11-14T09:01:05.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 439.941109ms iteration = 5 status = {"generation":2}
12962024-11-14T09:01:05.980ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12972024-11-14T09:01:05.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12982024-11-14T09:01:05.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ac4f289d-6a1b-4c74-90d3-2bfd7c726fac", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
12992024-11-14T09:01:05.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13002024-11-14T09:01:05.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13012024-11-14T09:01:05.985ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13022024-11-14T09:01:05.985ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 457.683093ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13032024-11-14T09:01:05.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13042024-11-14T09:01:05.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13052024-11-14T09:01:05.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13062024-11-14T09:01:05.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13072024-11-14T09:01:05.991ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13082024-11-14T09:01:05.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13092024-11-14T09:01:05.994ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
13102024-11-14T09:01:05.994ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 467.101445ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13112024-11-14T09:01:05.995ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "959dfbb8-ca6c-4e74-baa9-e1a7d3f19d53", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13122024-11-14T09:01:05.997ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 469.661336ms iteration = 8 status = {}
13132024-11-14T09:01:05.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13142024-11-14T09:01:05.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13152024-11-14T09:01:06.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162024-11-14T09:01:06.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13172024-11-14T09:01:06.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13182024-11-14T09:01:06.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13192024-11-14T09:01:06.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202024-11-14T09:01:06.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13212024-11-14T09:01:06.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13222024-11-14T09:01:06.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13232024-11-14T09:01:06.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13242024-11-14T09:01:06.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13252024-11-14T09:01:06.011ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
13262024-11-14T09:01:06.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13272024-11-14T09:01:06.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13282024-11-14T09:01:06.021ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13292024-11-14T09:01:06.021ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b221fd40-0e1a-44a0-8241-9795dd39bcf2", "content-length": "134", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13302024-11-14T09:01:06.021ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13312024-11-14T09:01:06.021ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
13322024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13332024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13342024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13352024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13362024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13372024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13382024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13392024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13402024-11-14T09:01:06.022ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
13412024-11-14T09:01:06.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13422024-11-14T09:01:06.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13432024-11-14T09:01:06.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13442024-11-14T09:01:06.027ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c72637fb-685f-4bf7-8da9-95d87b6f5f6c", "content-length": "2", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13452024-11-14T09:01:06.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13462024-11-14T09:01:06.027ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c25a6f39-6133-411e-af01-bade89dbec13", "content-length": "52", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13472024-11-14T09:01:06.027ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
13482024-11-14T09:01:06.027ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13492024-11-14T09:01:06.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 23beaaf4-377d-48e7-a6b5-2698af00dfa8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13502024-11-14T09:01:06.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 23beaaf4-377d-48e7-a6b5-2698af00dfa8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13512024-11-14T09:01:06.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 23beaaf4-377d-48e7-a6b5-2698af00dfa8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13522024-11-14T09:01:06.092ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13532024-11-14T09:01:06.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6eb4508-f128-48ba-8295-192b3121f511", "content-length": "691", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13542024-11-14T09:01:06.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13552024-11-14T09:01:06.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13562024-11-14T09:01:06.095ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13572024-11-14T09:01:06.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 569.458099ms iteration = 7 status = {}
13582024-11-14T09:01:06.134ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5438da5a-b9b4-4939-b1a9-508be8486c00", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13592024-11-14T09:01:06.134ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
13602024-11-14T09:01:06.134ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13612024-11-14T09:01:06.134ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2174d480-2432-43e3-b883-463fbc518d85", "content-length": "682", "date": "Thu, 14 Nov 2024 09:01:05 GMT"} })
13622024-11-14T09:01:06.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13632024-11-14T09:01:06.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13642024-11-14T09:01:06.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13652024-11-14T09:01:06.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13662024-11-14T09:01:06.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13672024-11-14T09:01:06.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13682024-11-14T09:01:06.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13692024-11-14T09:01:06.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13702024-11-14T09:01:06.151ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.204008ms iteration = 7 status = {}
13712024-11-14T09:01:06.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 557d0168-3a88-4c05-9874-9ea9d0f0362e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13722024-11-14T09:01:06.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 557d0168-3a88-4c05-9874-9ea9d0f0362e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13732024-11-14T09:01:06.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 557d0168-3a88-4c05-9874-9ea9d0f0362e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13742024-11-14T09:01:07.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 620fdcda-c6e6-4ba1-bf86-6e5a9e98e3fd roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13752024-11-14T09:01:07.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 620fdcda-c6e6-4ba1-bf86-6e5a9e98e3fd resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13762024-11-14T09:01:07.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 620fdcda-c6e6-4ba1-bf86-6e5a9e98e3fd response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13772024-11-14T09:01:08.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ae8e5b6-d57b-428c-bbf3-01249cad20b4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13782024-11-14T09:01:08.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ae8e5b6-d57b-428c-bbf3-01249cad20b4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13792024-11-14T09:01:08.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ae8e5b6-d57b-428c-bbf3-01249cad20b4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13802024-11-14T09:01:09.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3a54d0e-54b5-4da5-a15c-e637cc5eaeb9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13812024-11-14T09:01:09.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3a54d0e-54b5-4da5-a15c-e637cc5eaeb9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13822024-11-14T09:01:09.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3a54d0e-54b5-4da5-a15c-e637cc5eaeb9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13832024-11-14T09:01:10.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 931f263d-4804-4f4c-9a1e-4b8a5f8d0d0e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13842024-11-14T09:01:10.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 931f263d-4804-4f4c-9a1e-4b8a5f8d0d0e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13852024-11-14T09:01:10.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 931f263d-4804-4f4c-9a1e-4b8a5f8d0d0e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13862024-11-14T09:01:11.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 896a0b5c-ba87-44c0-9ee7-84a35d1c4be0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13872024-11-14T09:01:11.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 896a0b5c-ba87-44c0-9ee7-84a35d1c4be0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13882024-11-14T09:01:11.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 896a0b5c-ba87-44c0-9ee7-84a35d1c4be0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13892024-11-14T09:01:12.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ea5b5c2-6f28-46c8-9409-ea8a40b9ab2c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13902024-11-14T09:01:12.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ea5b5c2-6f28-46c8-9409-ea8a40b9ab2c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13912024-11-14T09:01:12.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ea5b5c2-6f28-46c8-9409-ea8a40b9ab2c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13922024-11-14T09:01:13.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f25659f9-e018-454c-ad0c-801bd01c5fbb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13932024-11-14T09:01:13.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f25659f9-e018-454c-ad0c-801bd01c5fbb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13942024-11-14T09:01:13.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f25659f9-e018-454c-ad0c-801bd01c5fbb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13952024-11-14T09:01:14.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = d0652253-d2f4-4dc8-a2ec-6df103f2398d response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
13962024-11-14T09:01:14.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b3e15082-3740-46fb-9f6b-b202046d3dda roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13972024-11-14T09:01:14.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b3e15082-3740-46fb-9f6b-b202046d3dda resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13982024-11-14T09:01:14.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b3e15082-3740-46fb-9f6b-b202046d3dda response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
13992024-11-14T09:01:15.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92ccd4f8-6f29-423a-800a-a78aefcf0207 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14002024-11-14T09:01:15.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92ccd4f8-6f29-423a-800a-a78aefcf0207 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14012024-11-14T09:01:15.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92ccd4f8-6f29-423a-800a-a78aefcf0207 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14022024-11-14T09:01:15.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
14032024-11-14T09:01:15.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
14042024-11-14T09:01:15.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14052024-11-14T09:01:15.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14062024-11-14T09:01:15.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14072024-11-14T09:01:15.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14082024-11-14T09:01:15.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14092024-11-14T09:01:15.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14102024-11-14T09:01:15.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112024-11-14T09:01:15.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14122024-11-14T09:01:15.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14132024-11-14T09:01:15.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14142024-11-14T09:01:15.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14152024-11-14T09:01:15.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14162024-11-14T09:01:15.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172024-11-14T09:01:15.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
14182024-11-14T09:01:15.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192024-11-14T09:01:15.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202024-11-14T09:01:15.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
14212024-11-14T09:01:15.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.16817ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
14222024-11-14T09:01:15.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.220929ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14232024-11-14T09:01:16.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1de1adf-894a-4314-8085-9a2c860ac627 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14242024-11-14T09:01:16.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1de1adf-894a-4314-8085-9a2c860ac627 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14252024-11-14T09:01:16.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1de1adf-894a-4314-8085-9a2c860ac627 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14262024-11-14T09:01:17.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5d81ff3-fe96-4fd5-bee1-6ab174d0280e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14272024-11-14T09:01:17.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5d81ff3-fe96-4fd5-bee1-6ab174d0280e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14282024-11-14T09:01:17.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5d81ff3-fe96-4fd5-bee1-6ab174d0280e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14292024-11-14T09:01:18.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ee7cc7d-68cd-4fc8-9476-7b26f0ab1b55 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14302024-11-14T09:01:18.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ee7cc7d-68cd-4fc8-9476-7b26f0ab1b55 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14312024-11-14T09:01:18.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ee7cc7d-68cd-4fc8-9476-7b26f0ab1b55 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14322024-11-14T09:01:19.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9977d549-a8ee-4b46-80bf-effa62fdaaf8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14332024-11-14T09:01:19.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9977d549-a8ee-4b46-80bf-effa62fdaaf8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14342024-11-14T09:01:19.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9977d549-a8ee-4b46-80bf-effa62fdaaf8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14352024-11-14T09:01:20.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1953ba44-ca5c-4e4e-8030-06dd06349232 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14362024-11-14T09:01:20.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1953ba44-ca5c-4e4e-8030-06dd06349232 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14372024-11-14T09:01:20.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1953ba44-ca5c-4e4e-8030-06dd06349232 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14382024-11-14T09:01:21.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e30253a-e88c-4435-874e-70a5155aa0a7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14392024-11-14T09:01:21.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e30253a-e88c-4435-874e-70a5155aa0a7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14402024-11-14T09:01:21.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e30253a-e88c-4435-874e-70a5155aa0a7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14412024-11-14T09:01:22.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12fd63a2-05e4-4ef5-9ba6-7a7cd2cd086f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14422024-11-14T09:01:22.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12fd63a2-05e4-4ef5-9ba6-7a7cd2cd086f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14432024-11-14T09:01:22.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12fd63a2-05e4-4ef5-9ba6-7a7cd2cd086f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14442024-11-14T09:01:23.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 010872cd-7b27-411c-ab54-a63fc096feab roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14452024-11-14T09:01:23.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 010872cd-7b27-411c-ab54-a63fc096feab resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14462024-11-14T09:01:23.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 010872cd-7b27-411c-ab54-a63fc096feab response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14472024-11-14T09:01:24.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66933044-5a1c-4d3d-9e23-a7e231db3a90 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14482024-11-14T09:01:24.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66933044-5a1c-4d3d-9e23-a7e231db3a90 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14492024-11-14T09:01:24.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66933044-5a1c-4d3d-9e23-a7e231db3a90 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14502024-11-14T09:01:25.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 13a14d5d-a3a8-4866-8fc2-80da5c411da0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14512024-11-14T09:01:25.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 13a14d5d-a3a8-4866-8fc2-80da5c411da0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14522024-11-14T09:01:25.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 13a14d5d-a3a8-4866-8fc2-80da5c411da0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14532024-11-14T09:01:25.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
14542024-11-14T09:01:25.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
14552024-11-14T09:01:25.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14562024-11-14T09:01:25.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14572024-11-14T09:01:25.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14582024-11-14T09:01:25.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14592024-11-14T09:01:25.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602024-11-14T09:01:25.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14612024-11-14T09:01:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14622024-11-14T09:01:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14632024-11-14T09:01:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14642024-11-14T09:01:25.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.834548ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14652024-11-14T09:01:25.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14662024-11-14T09:01:25.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14672024-11-14T09:01:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14682024-11-14T09:01:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692024-11-14T09:01:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
14702024-11-14T09:01:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14712024-11-14T09:01:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14722024-11-14T09:01:25.549ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
14732024-11-14T09:01:25.549ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.607667ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
14742024-11-14T09:01:26.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c21adb7d-fbea-480e-aa23-c7411faf9681 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14752024-11-14T09:01:26.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c21adb7d-fbea-480e-aa23-c7411faf9681 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14762024-11-14T09:01:26.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c21adb7d-fbea-480e-aa23-c7411faf9681 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14772024-11-14T09:01:27.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 408cee31-08b7-4ad0-9a2a-2bf84e3196ae roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14782024-11-14T09:01:27.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 408cee31-08b7-4ad0-9a2a-2bf84e3196ae resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14792024-11-14T09:01:27.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 408cee31-08b7-4ad0-9a2a-2bf84e3196ae response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14802024-11-14T09:01:28.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae7b4c8-77a0-418b-a6ec-a8931ac0eb68 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14812024-11-14T09:01:28.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae7b4c8-77a0-418b-a6ec-a8931ac0eb68 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14822024-11-14T09:01:28.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae7b4c8-77a0-418b-a6ec-a8931ac0eb68 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14832024-11-14T09:01:29.045ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1417 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = c17028bb-3567-4b2a-b793-0a2095bc2ed8 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
14842024-11-14T09:01:29.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9a8b2a24-8fa3-4417-b1c7-c62c4d402a85 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14852024-11-14T09:01:29.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9a8b2a24-8fa3-4417-b1c7-c62c4d402a85 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14862024-11-14T09:01:29.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9a8b2a24-8fa3-4417-b1c7-c62c4d402a85 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14872024-11-14T09:01:30.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fcf7a479-1646-46a2-a5e9-890a989b69f4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14882024-11-14T09:01:30.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fcf7a479-1646-46a2-a5e9-890a989b69f4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14892024-11-14T09:01:30.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fcf7a479-1646-46a2-a5e9-890a989b69f4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14902024-11-14T09:01:31.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9fa1ef1-9d1c-4846-86e4-f2cd74a8d6f0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14912024-11-14T09:01:31.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9fa1ef1-9d1c-4846-86e4-f2cd74a8d6f0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14922024-11-14T09:01:31.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9fa1ef1-9d1c-4846-86e4-f2cd74a8d6f0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14932024-11-14T09:01:32.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 39a97a35-b82d-4732-ba3a-d314a35be83c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14942024-11-14T09:01:32.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 39a97a35-b82d-4732-ba3a-d314a35be83c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14952024-11-14T09:01:32.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 39a97a35-b82d-4732-ba3a-d314a35be83c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14962024-11-14T09:01:33.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cab0ac4e-4932-4e25-b246-ab4474521485 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14972024-11-14T09:01:33.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cab0ac4e-4932-4e25-b246-ab4474521485 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14982024-11-14T09:01:33.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cab0ac4e-4932-4e25-b246-ab4474521485 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
14992024-11-14T09:01:34.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = bf40326c-f628-48f8-b421-8d9ea2d964d7 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
15002024-11-14T09:01:34.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = bf40326c-f628-48f8-b421-8d9ea2d964d7 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
15012024-11-14T09:01:34.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = bf40326c-f628-48f8-b421-8d9ea2d964d7 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
15022024-11-14T09:01:34.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 4f84128f-c32d-40bc-ac89-56d9b22cbcb3 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
15032024-11-14T09:01:34.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 4f84128f-c32d-40bc-ac89-56d9b22cbcb3 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
15042024-11-14T09:01:34.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 4f84128f-c32d-40bc-ac89-56d9b22cbcb3 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
15052024-11-14T09:01:34.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0a00c45-365e-49c8-8e72-465ea2b4d307 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
15062024-11-14T09:01:34.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0a00c45-365e-49c8-8e72-465ea2b4d307 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
15072024-11-14T09:01:34.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0a00c45-365e-49c8-8e72-465ea2b4d307 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
15082024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
15092024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
15102024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15112024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15122024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
15132024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
15142024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15152024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
15162024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15172024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15182024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
15192024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
15202024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15212024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
15222024-11-14T09:01:35.528ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15232024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15242024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
15252024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
15262024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15272024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15282024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
15292024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
15302024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15312024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15322024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15332024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
15342024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15352024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15362024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15372024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15382024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15392024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15402024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15412024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15422024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15432024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15442024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15452024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15462024-11-14T09:01:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15472024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
15482024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
15492024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
15502024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15512024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15522024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
15532024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15542024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15552024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15562024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15572024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15582024-11-14T09:01:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15592024-11-14T09:01:35.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15602024-11-14T09:01:35.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612024-11-14T09:01:35.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-11-14T09:01:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15632024-11-14T09:01:35.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15642024-11-14T09:01:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15652024-11-14T09:01:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15662024-11-14T09:01:35.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15672024-11-14T09:01:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15682024-11-14T09:01:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15692024-11-14T09:01:35.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15702024-11-14T09:01:35.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-11-14T09:01:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15722024-11-14T09:01:35.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-11-14T09:01:35.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 327481823 } })
15742024-11-14T09:01:35.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
15752024-11-14T09:01:35.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15762024-11-14T09:01:35.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15772024-11-14T09:01:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15782024-11-14T09:01:35.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15792024-11-14T09:01:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15802024-11-14T09:01:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15812024-11-14T09:01:35.541ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15822024-11-14T09:01:35.541ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15832024-11-14T09:01:35.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15842024-11-14T09:01:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15852024-11-14T09:01:35.542ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 14.811248ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15862024-11-14T09:01:35.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15872024-11-14T09:01:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15882024-11-14T09:01:35.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 335046605 } })
15892024-11-14T09:01:35.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15902024-11-14T09:01:35.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
15912024-11-14T09:01:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15922024-11-14T09:01:35.552ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15932024-11-14T09:01:35.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.001436ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15942024-11-14T09:01:35.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15952024-11-14T09:01:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15962024-11-14T09:01:35.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15972024-11-14T09:01:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15982024-11-14T09:01:35.587ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15992024-11-14T09:01:35.587ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16002024-11-14T09:01:35.587ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00ebb485-b309-4d2f-8dff-d5784793375a", "content-length": "26", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16012024-11-14T09:01:35.587ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16022024-11-14T09:01:35.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16032024-11-14T09:01:35.589ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16042024-11-14T09:01:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16052024-11-14T09:01:35.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16062024-11-14T09:01:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16072024-11-14T09:01:35.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.975781ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
16082024-11-14T09:01:35.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-11-14T09:01:35.592ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16102024-11-14T09:01:35.592ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16112024-11-14T09:01:35.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16122024-11-14T09:01:35.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16132024-11-14T09:01:35.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16142024-11-14T09:01:35.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16152024-11-14T09:01:35.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16162024-11-14T09:01:35.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172024-11-14T09:01:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16182024-11-14T09:01:35.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16192024-11-14T09:01:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16202024-11-14T09:01:35.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.000607ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
16212024-11-14T09:01:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
16222024-11-14T09:01:35.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16232024-11-14T09:01:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16242024-11-14T09:01:35.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16252024-11-14T09:01:35.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16262024-11-14T09:01:35.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16272024-11-14T09:01:35.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16282024-11-14T09:01:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16292024-11-14T09:01:35.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-11-14T09:01:35.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
16312024-11-14T09:01:35.602ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16322024-11-14T09:01:35.602ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b40076ee-b9aa-4ad4-9576-66b190ee3aae", "content-length": "26", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16332024-11-14T09:01:35.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16342024-11-14T09:01:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16352024-11-14T09:01:35.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16362024-11-14T09:01:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16372024-11-14T09:01:35.605ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
16382024-11-14T09:01:35.610ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
16392024-11-14T09:01:35.610ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.17336ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
16402024-11-14T09:01:35.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16412024-11-14T09:01:35.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16422024-11-14T09:01:35.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.216382ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16432024-11-14T09:01:35.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.77355ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16442024-11-14T09:01:35.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.680827ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16452024-11-14T09:01:35.631ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16462024-11-14T09:01:35.631ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16472024-11-14T09:01:35.631ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.856493ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16482024-11-14T09:01:35.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 436333732 } })
16492024-11-14T09:01:35.646ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
16502024-11-14T09:01:35.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.18449ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16512024-11-14T09:01:35.659ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 130.829402ms iteration = 8 status = {}
16522024-11-14T09:01:35.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16532024-11-14T09:01:35.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16542024-11-14T09:01:35.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05d9990d-732d-47fa-855d-9bebb071a789 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
16552024-11-14T09:01:35.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05d9990d-732d-47fa-855d-9bebb071a789 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
16562024-11-14T09:01:35.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16572024-11-14T09:01:35.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16582024-11-14T09:01:35.706ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.697932ms iteration = 11 status = {"physical_disks_added":0}
16592024-11-14T09:01:35.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16602024-11-14T09:01:35.714ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16612024-11-14T09:01:35.714ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "751b8fc4-eee4-4507-9de5-b06248af62d4", "content-length": "26", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16622024-11-14T09:01:35.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16632024-11-14T09:01:35.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16642024-11-14T09:01:35.734ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16652024-11-14T09:01:35.734ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16662024-11-14T09:01:35.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05d9990d-732d-47fa-855d-9bebb071a789 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
16672024-11-14T09:01:35.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16682024-11-14T09:01:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
16692024-11-14T09:01:35.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16702024-11-14T09:01:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16712024-11-14T09:01:35.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 213.984208ms iteration = 8 status = 0
16722024-11-14T09:01:35.743ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5124a9a0-74e5-491e-8483-aca52e8fa336", "content-length": "372", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16732024-11-14T09:01:35.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16742024-11-14T09:01:35.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16752024-11-14T09:01:35.760ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16762024-11-14T09:01:35.760ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16772024-11-14T09:01:35.760ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16782024-11-14T09:01:35.760ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7419f90a-18c0-4ad6-abf8-d6dcaddd6bb4", "content-length": "1", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16792024-11-14T09:01:35.760ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1ea8289a-8d1a-4041-a302-103cfbccf14a", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16802024-11-14T09:01:35.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16812024-11-14T09:01:35.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16822024-11-14T09:01:35.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16832024-11-14T09:01:35.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16842024-11-14T09:01:35.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16852024-11-14T09:01:35.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16862024-11-14T09:01:35.765ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.12133ms iteration = 8 status = null
16872024-11-14T09:01:35.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16882024-11-14T09:01:35.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16892024-11-14T09:01:35.769ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16902024-11-14T09:01:35.769ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16912024-11-14T09:01:35.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16922024-11-14T09:01:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16932024-11-14T09:01:35.770ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aac117cd-cc8d-46e0-9212-87cf7d02c694", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
16942024-11-14T09:01:35.773ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 245.131669ms iteration = 9 status = {}
16952024-11-14T09:01:35.773ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
16962024-11-14T09:01:35.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16972024-11-14T09:01:35.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16982024-11-14T09:01:35.781ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16992024-11-14T09:01:35.781ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "44520e03-bff2-4507-b88f-def848d87e03", "content-length": "134", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
17002024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17012024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
17022024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17032024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17042024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17052024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17062024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17072024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17082024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17092024-11-14T09:01:35.781ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17102024-11-14T09:01:35.782ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
17112024-11-14T09:01:35.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17122024-11-14T09:01:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17132024-11-14T09:01:35.783ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17142024-11-14T09:01:35.783ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "374bcc5a-4ffa-4553-9e15-2af4d3434b5a", "content-length": "2", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
17152024-11-14T09:01:35.783ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17162024-11-14T09:01:35.784ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c80a8bf-3fa4-41a4-aa4a-3bc02eaccf05", "content-length": "52", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
17172024-11-14T09:01:35.784ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
17182024-11-14T09:01:35.784ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17192024-11-14T09:01:35.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17202024-11-14T09:01:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17212024-11-14T09:01:35.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17222024-11-14T09:01:35.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17232024-11-14T09:01:35.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17242024-11-14T09:01:35.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17252024-11-14T09:01:35.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17262024-11-14T09:01:35.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17272024-11-14T09:01:35.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17282024-11-14T09:01:35.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17292024-11-14T09:01:35.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17302024-11-14T09:01:35.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e08abd4e-769b-43e7-8003-231b0edbfff9", "content-length": "691", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
17312024-11-14T09:01:35.873ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17322024-11-14T09:01:35.873ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17332024-11-14T09:01:35.873ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17342024-11-14T09:01:35.875ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.31683ms iteration = 8 status = {}
17352024-11-14T09:01:35.911ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c653ded0-358f-45c0-935e-0d1aa7e4ec19", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
17362024-11-14T09:01:35.911ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
17372024-11-14T09:01:35.911ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17382024-11-14T09:01:35.911ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac70ea71-a838-4194-a1ff-f0524fb4e61e", "content-length": "682", "date": "Thu, 14 Nov 2024 09:01:35 GMT"} })
17392024-11-14T09:01:35.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17402024-11-14T09:01:35.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17412024-11-14T09:01:35.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17422024-11-14T09:01:35.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17432024-11-14T09:01:35.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17442024-11-14T09:01:35.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17452024-11-14T09:01:35.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17462024-11-14T09:01:35.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17472024-11-14T09:01:35.928ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 400.17997ms iteration = 8 status = {}
17482024-11-14T09:01:36.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f00d090f-cf86-4390-a3c7-6668acf11c77 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17492024-11-14T09:01:36.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f00d090f-cf86-4390-a3c7-6668acf11c77 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17502024-11-14T09:01:36.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f00d090f-cf86-4390-a3c7-6668acf11c77 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17512024-11-14T09:01:36.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a5b3f5aa-de2e-4a03-9ac7-d3d69ea0dbd1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17522024-11-14T09:01:36.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a5b3f5aa-de2e-4a03-9ac7-d3d69ea0dbd1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17532024-11-14T09:01:36.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a5b3f5aa-de2e-4a03-9ac7-d3d69ea0dbd1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17542024-11-14T09:01:37.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fdd69a04-d819-4a7c-a32d-3e2673623b7c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17552024-11-14T09:01:37.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fdd69a04-d819-4a7c-a32d-3e2673623b7c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17562024-11-14T09:01:37.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fdd69a04-d819-4a7c-a32d-3e2673623b7c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17572024-11-14T09:01:38.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9545552-060e-4ff0-9a0c-2db6bbe56119 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17582024-11-14T09:01:38.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9545552-060e-4ff0-9a0c-2db6bbe56119 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17592024-11-14T09:01:38.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9545552-060e-4ff0-9a0c-2db6bbe56119 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17602024-11-14T09:01:39.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 065faff4-f0f1-45d6-8906-e66060689f0d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17612024-11-14T09:01:39.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 065faff4-f0f1-45d6-8906-e66060689f0d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17622024-11-14T09:01:39.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 065faff4-f0f1-45d6-8906-e66060689f0d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17632024-11-14T09:01:40.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8099ace9-ac35-426a-9f45-0fcd3c9916c4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17642024-11-14T09:01:40.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8099ace9-ac35-426a-9f45-0fcd3c9916c4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17652024-11-14T09:01:40.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8099ace9-ac35-426a-9f45-0fcd3c9916c4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17662024-11-14T09:01:41.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 825b305d-e172-4084-bb90-f349653854b2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17672024-11-14T09:01:41.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 825b305d-e172-4084-bb90-f349653854b2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17682024-11-14T09:01:41.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 825b305d-e172-4084-bb90-f349653854b2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17692024-11-14T09:01:42.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7479a205-fdd1-4a41-90c2-423863a1eaaa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17702024-11-14T09:01:42.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7479a205-fdd1-4a41-90c2-423863a1eaaa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17712024-11-14T09:01:42.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7479a205-fdd1-4a41-90c2-423863a1eaaa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17722024-11-14T09:01:43.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 890117c4-7aea-48ff-824b-b53e232dd054 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17732024-11-14T09:01:43.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 890117c4-7aea-48ff-824b-b53e232dd054 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17742024-11-14T09:01:43.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 890117c4-7aea-48ff-824b-b53e232dd054 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17752024-11-14T09:01:44.045ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1341 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = d9493b1a-114f-4b38-8d11-b6c890617a00 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
17762024-11-14T09:01:44.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e82d3fd7-2c47-4f99-9228-8f8f9b8bd6a2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17772024-11-14T09:01:44.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e82d3fd7-2c47-4f99-9228-8f8f9b8bd6a2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17782024-11-14T09:01:44.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e82d3fd7-2c47-4f99-9228-8f8f9b8bd6a2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
17792024-11-14T09:01:45.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
17802024-11-14T09:01:45.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17812024-11-14T09:01:45.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
17822024-11-14T09:01:45.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17832024-11-14T09:01:45.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17842024-11-14T09:01:45.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17852024-11-14T09:01:45.566ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17862024-11-14T09:01:45.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17872024-11-14T09:01:45.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-11-14T09:01:45.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.501597ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17892024-11-14T09:01:45.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17902024-11-14T09:01:45.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17912024-11-14T09:01:45.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17922024-11-14T09:01:45.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17932024-11-14T09:01:45.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17942024-11-14T09:01:45.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952024-11-14T09:01:45.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
17962024-11-14T09:01:45.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17972024-11-14T09:01:45.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982024-11-14T09:01:45.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
17992024-11-14T09:01:45.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.945457ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
18002024-11-14T09:01:45.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09ba3165-f8ce-415d-b242-ff58e0dcbe4f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18012024-11-14T09:01:45.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09ba3165-f8ce-415d-b242-ff58e0dcbe4f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18022024-11-14T09:01:45.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09ba3165-f8ce-415d-b242-ff58e0dcbe4f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18032024-11-14T09:01:46.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3474c603-4469-4f18-ad79-ab7cf4d57d10 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18042024-11-14T09:01:46.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3474c603-4469-4f18-ad79-ab7cf4d57d10 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18052024-11-14T09:01:46.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3474c603-4469-4f18-ad79-ab7cf4d57d10 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18062024-11-14T09:01:48.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 842d47ab-2c0b-4359-8299-3e09f90654ff roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18072024-11-14T09:01:48.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 842d47ab-2c0b-4359-8299-3e09f90654ff resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18082024-11-14T09:01:48.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 842d47ab-2c0b-4359-8299-3e09f90654ff response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18092024-11-14T09:01:49.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d8cb3a2-7ad7-44aa-9b29-81ddde877f22 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18102024-11-14T09:01:49.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d8cb3a2-7ad7-44aa-9b29-81ddde877f22 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18112024-11-14T09:01:49.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d8cb3a2-7ad7-44aa-9b29-81ddde877f22 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18122024-11-14T09:01:50.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dfed2f79-980b-4fa1-8486-0de6dfc18bf4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18132024-11-14T09:01:50.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dfed2f79-980b-4fa1-8486-0de6dfc18bf4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18142024-11-14T09:01:50.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dfed2f79-980b-4fa1-8486-0de6dfc18bf4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18152024-11-14T09:01:51.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 54589685-8d1d-4593-85d6-2cba59574860 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18162024-11-14T09:01:51.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 54589685-8d1d-4593-85d6-2cba59574860 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18172024-11-14T09:01:51.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 54589685-8d1d-4593-85d6-2cba59574860 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18182024-11-14T09:01:52.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 944d7da3-3325-4b05-8869-7760c536c35b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18192024-11-14T09:01:52.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 944d7da3-3325-4b05-8869-7760c536c35b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18202024-11-14T09:01:52.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 944d7da3-3325-4b05-8869-7760c536c35b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18212024-11-14T09:01:53.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6bfcfead-671f-48f8-93f5-361e5c6e5af5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18222024-11-14T09:01:53.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6bfcfead-671f-48f8-93f5-361e5c6e5af5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18232024-11-14T09:01:53.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6bfcfead-671f-48f8-93f5-361e5c6e5af5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18242024-11-14T09:01:54.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4102ce1c-1b92-40ee-943a-3a19594a6239 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18252024-11-14T09:01:54.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4102ce1c-1b92-40ee-943a-3a19594a6239 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18262024-11-14T09:01:54.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4102ce1c-1b92-40ee-943a-3a19594a6239 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18272024-11-14T09:01:55.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aba88c80-6d00-48b2-96c3-9c8082c144cf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18282024-11-14T09:01:55.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aba88c80-6d00-48b2-96c3-9c8082c144cf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18292024-11-14T09:01:55.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aba88c80-6d00-48b2-96c3-9c8082c144cf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18302024-11-14T09:01:55.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
18312024-11-14T09:01:55.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
18322024-11-14T09:01:55.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18332024-11-14T09:01:55.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18342024-11-14T09:01:55.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18352024-11-14T09:01:55.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18362024-11-14T09:01:55.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18372024-11-14T09:01:55.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18382024-11-14T09:01:55.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18392024-11-14T09:01:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18402024-11-14T09:01:55.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18412024-11-14T09:01:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18422024-11-14T09:01:55.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18432024-11-14T09:01:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18442024-11-14T09:01:55.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18452024-11-14T09:01:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
18462024-11-14T09:01:55.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18472024-11-14T09:01:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18482024-11-14T09:01:55.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
18492024-11-14T09:01:55.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.029332ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
18502024-11-14T09:01:55.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.173501ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18512024-11-14T09:01:56.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f3bc11e-7cb1-47ea-9981-b9bb6285eb7e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18522024-11-14T09:01:56.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f3bc11e-7cb1-47ea-9981-b9bb6285eb7e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18532024-11-14T09:01:56.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f3bc11e-7cb1-47ea-9981-b9bb6285eb7e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18542024-11-14T09:01:57.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d06e738-1962-42c7-b75e-645cb9fa319b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18552024-11-14T09:01:57.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d06e738-1962-42c7-b75e-645cb9fa319b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18562024-11-14T09:01:57.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d06e738-1962-42c7-b75e-645cb9fa319b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18572024-11-14T09:01:58.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a8fc330-3651-4820-9155-7c817639080c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18582024-11-14T09:01:58.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a8fc330-3651-4820-9155-7c817639080c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18592024-11-14T09:01:58.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a8fc330-3651-4820-9155-7c817639080c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18602024-11-14T09:01:59.044ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1387 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 004e90cb-ed0c-4c08-b708-4ddf68caa0dc response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
18612024-11-14T09:01:59.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 779156c2-5c78-4a0b-9b1f-1d73408010c1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18622024-11-14T09:01:59.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 779156c2-5c78-4a0b-9b1f-1d73408010c1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18632024-11-14T09:01:59.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 779156c2-5c78-4a0b-9b1f-1d73408010c1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18642024-11-14T09:02:00.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dc977dfa-6742-4924-b6b1-bc3660c51c23 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18652024-11-14T09:02:00.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dc977dfa-6742-4924-b6b1-bc3660c51c23 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18662024-11-14T09:02:00.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dc977dfa-6742-4924-b6b1-bc3660c51c23 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18672024-11-14T09:02:01.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 084356a0-115e-46dd-9259-b798aefa3d79 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18682024-11-14T09:02:01.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 084356a0-115e-46dd-9259-b798aefa3d79 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18692024-11-14T09:02:01.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 084356a0-115e-46dd-9259-b798aefa3d79 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18702024-11-14T09:02:02.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d3014b4-1ced-4b49-8115-4f8bcd202c22 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18712024-11-14T09:02:02.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d3014b4-1ced-4b49-8115-4f8bcd202c22 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18722024-11-14T09:02:02.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d3014b4-1ced-4b49-8115-4f8bcd202c22 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18732024-11-14T09:02:03.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 442c8562-f4d5-48a7-a127-de2c8d1556b4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18742024-11-14T09:02:03.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 442c8562-f4d5-48a7-a127-de2c8d1556b4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18752024-11-14T09:02:03.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 442c8562-f4d5-48a7-a127-de2c8d1556b4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18762024-11-14T09:02:04.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f7567c6b-de49-403e-8613-113044e947ee roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18772024-11-14T09:02:04.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f7567c6b-de49-403e-8613-113044e947ee resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18782024-11-14T09:02:04.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f7567c6b-de49-403e-8613-113044e947ee response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18792024-11-14T09:02:05.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 144ea399-9dbf-40ab-b783-547bdb61b5ef roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18802024-11-14T09:02:05.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 144ea399-9dbf-40ab-b783-547bdb61b5ef resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18812024-11-14T09:02:05.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 144ea399-9dbf-40ab-b783-547bdb61b5ef response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
18822024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
18832024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18842024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
18852024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
18862024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
18872024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
18882024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18892024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18902024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
18912024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
18922024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18932024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
18942024-11-14T09:02:05.528ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
18952024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.941\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
18962024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
18972024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
18982024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18992024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19002024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
19012024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
19022024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19032024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
19042024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19052024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19062024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19072024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
19082024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
19092024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19102024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
19112024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19122024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
19132024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19142024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
19152024-11-14T09:02:05.528ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
19162024-11-14T09:02:05.528ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:52:05.528941763 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19172024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19182024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
19192024-11-14T09:02:05.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19202024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19212024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
19222024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
19232024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19242024-11-14T09:02:05.529ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19252024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19262024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
19272024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19282024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
19292024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19302024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
19312024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19322024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19332024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
19342024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19352024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
19362024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19372024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
19382024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19392024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19402024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
19412024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19422024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19432024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
19442024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19452024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19462024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19472024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19482024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19492024-11-14T09:02:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19502024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19512024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19522024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19532024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19542024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19552024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19562024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19572024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19582024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19592024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19602024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19612024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19622024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19632024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19642024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19652024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19662024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19672024-11-14T09:02:05.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 319581447 } })
19682024-11-14T09:02:05.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 319585096 } })
19692024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19702024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
19712024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.88898ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
19722024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
19732024-11-14T09:02:05.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.724517ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
19742024-11-14T09:02:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19752024-11-14T09:02:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19762024-11-14T09:02:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.738118ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19772024-11-14T09:02:05.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19782024-11-14T09:02:05.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19792024-11-14T09:02:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19802024-11-14T09:02:05.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19812024-11-14T09:02:05.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 327944991 } })
19822024-11-14T09:02:05.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
19832024-11-14T09:02:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19842024-11-14T09:02:05.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19852024-11-14T09:02:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19862024-11-14T09:02:05.540ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19872024-11-14T09:02:05.540ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19882024-11-14T09:02:05.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19892024-11-14T09:02:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19902024-11-14T09:02:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19912024-11-14T09:02:05.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19922024-11-14T09:02:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19932024-11-14T09:02:05.542ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:52:05.528941763 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19942024-11-14T09:02:05.542ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.308144ms iteration = 5 status = {"expiration":"2024-11-14T08:52:05.528941763Z","pruned":[]}
19952024-11-14T09:02:05.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19962024-11-14T09:02:05.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19972024-11-14T09:02:05.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 333442589 } })
19982024-11-14T09:02:05.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
19992024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20002024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20012024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20022024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20032024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20042024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20052024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20062024-11-14T09:02:05.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20072024-11-14T09:02:05.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082024-11-14T09:02:05.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20092024-11-14T09:02:05.556ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20102024-11-14T09:02:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20112024-11-14T09:02:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20122024-11-14T09:02:05.556ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20132024-11-14T09:02:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20142024-11-14T09:02:05.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20152024-11-14T09:02:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20162024-11-14T09:02:05.561ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20172024-11-14T09:02:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20182024-11-14T09:02:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20192024-11-14T09:02:05.564ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 34.849219ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
20202024-11-14T09:02:05.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.564291ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20212024-11-14T09:02:05.567ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20222024-11-14T09:02:05.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20232024-11-14T09:02:05.567ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20242024-11-14T09:02:05.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20252024-11-14T09:02:05.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 356985837 } })
20262024-11-14T09:02:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20272024-11-14T09:02:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20282024-11-14T09:02:05.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20292024-11-14T09:02:05.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
20302024-11-14T09:02:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20312024-11-14T09:02:05.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20322024-11-14T09:02:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20332024-11-14T09:02:05.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342024-11-14T09:02:05.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-11-14T09:02:05.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20362024-11-14T09:02:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20372024-11-14T09:02:05.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20382024-11-14T09:02:05.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20392024-11-14T09:02:05.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20402024-11-14T09:02:05.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20412024-11-14T09:02:05.581ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20422024-11-14T09:02:05.581ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20432024-11-14T09:02:05.581ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.94083ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20442024-11-14T09:02:05.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-11-14T09:02:05.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462024-11-14T09:02:05.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20472024-11-14T09:02:05.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20482024-11-14T09:02:05.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20492024-11-14T09:02:05.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.796737ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
20502024-11-14T09:02:05.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20512024-11-14T09:02:05.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20522024-11-14T09:02:05.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20532024-11-14T09:02:05.593ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20542024-11-14T09:02:05.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20552024-11-14T09:02:05.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562024-11-14T09:02:05.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20572024-11-14T09:02:05.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20582024-11-14T09:02:05.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20592024-11-14T09:02:05.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20602024-11-14T09:02:05.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20612024-11-14T09:02:05.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20622024-11-14T09:02:05.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.442302ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20632024-11-14T09:02:05.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20642024-11-14T09:02:05.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20652024-11-14T09:02:05.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20662024-11-14T09:02:05.608ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20672024-11-14T09:02:05.608ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20682024-11-14T09:02:05.608ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.69847ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20692024-11-14T09:02:05.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20702024-11-14T09:02:05.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.440448ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
20712024-11-14T09:02:05.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.231078ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20722024-11-14T09:02:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20732024-11-14T09:02:05.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20742024-11-14T09:02:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20752024-11-14T09:02:05.628ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20762024-11-14T09:02:05.628ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20772024-11-14T09:02:05.628ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20782024-11-14T09:02:05.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20792024-11-14T09:02:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20802024-11-14T09:02:05.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20812024-11-14T09:02:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20822024-11-14T09:02:05.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20832024-11-14T09:02:05.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20852024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20862024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20872024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20882024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20892024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20902024-11-14T09:02:05.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20912024-11-14T09:02:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20922024-11-14T09:02:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20932024-11-14T09:02:05.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20942024-11-14T09:02:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20952024-11-14T09:02:05.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962024-11-14T09:02:05.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20972024-11-14T09:02:05.638ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20982024-11-14T09:02:05.638ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20992024-11-14T09:02:05.638ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.738333ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21002024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
21012024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 112.721962ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21022024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21032024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
21042024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21052024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21062024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21072024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21082024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21092024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
21102024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21112024-11-14T09:02:05.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21122024-11-14T09:02:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21132024-11-14T09:02:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21142024-11-14T09:02:05.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152024-11-14T09:02:05.646ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21162024-11-14T09:02:05.646ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21172024-11-14T09:02:05.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21182024-11-14T09:02:05.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21192024-11-14T09:02:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21202024-11-14T09:02:05.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21212024-11-14T09:02:05.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21222024-11-14T09:02:05.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21232024-11-14T09:02:05.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.072041ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21242024-11-14T09:02:05.651ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
21252024-11-14T09:02:05.651ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21262024-11-14T09:02:05.651ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
21272024-11-14T09:02:05.651ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 122.463678ms iteration = 6 status = {"generation":2}
21282024-11-14T09:02:05.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21292024-11-14T09:02:05.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21302024-11-14T09:02:05.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21312024-11-14T09:02:05.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
21322024-11-14T09:02:05.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.94406ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
21332024-11-14T09:02:05.656ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
21342024-11-14T09:02:05.657ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21352024-11-14T09:02:05.657ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21362024-11-14T09:02:05.657ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
21372024-11-14T09:02:05.657ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.693677ms iteration = 6 status = {"generation":1}
21382024-11-14T09:02:05.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21392024-11-14T09:02:05.664ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21402024-11-14T09:02:05.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 135.212593ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21412024-11-14T09:02:05.688ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
21422024-11-14T09:02:05.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 159.31943ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
21432024-11-14T09:02:05.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21442024-11-14T09:02:05.694ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21452024-11-14T09:02:05.695ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e3f813-f991-4636-9d40-f853e6212ad5", "content-length": "26", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
21462024-11-14T09:02:05.695ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21472024-11-14T09:02:05.697ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21482024-11-14T09:02:05.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21492024-11-14T09:02:05.697ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21502024-11-14T09:02:05.697ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2541675-a7ec-433f-9922-2b7ddb51a6d2", "content-length": "26", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
21512024-11-14T09:02:05.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21522024-11-14T09:02:05.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21532024-11-14T09:02:05.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21542024-11-14T09:02:05.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21552024-11-14T09:02:05.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562024-11-14T09:02:05.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21572024-11-14T09:02:05.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21582024-11-14T09:02:05.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21592024-11-14T09:02:05.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21602024-11-14T09:02:05.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21612024-11-14T09:02:05.714ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 185.352998ms iteration = 12 status = {"physical_disks_added":0}
21622024-11-14T09:02:05.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
21632024-11-14T09:02:05.739ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21642024-11-14T09:02:05.739ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "813ad28e-1dfd-4a87-aea6-d735e72ea1b0", "content-length": "26", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
21652024-11-14T09:02:05.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21662024-11-14T09:02:05.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
21672024-11-14T09:02:05.821ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21682024-11-14T09:02:05.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21692024-11-14T09:02:05.825ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0efc7fad-be9a-4cb0-abad-24588bbc8e49", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21702024-11-14T09:02:05.825ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21712024-11-14T09:02:05.828ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "eb09e613-8b45-43e3-97ba-57c00feac087", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21722024-11-14T09:02:05.828ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21732024-11-14T09:02:05.830ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21742024-11-14T09:02:05.830ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 301.942951ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21752024-11-14T09:02:05.833ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21762024-11-14T09:02:05.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21772024-11-14T09:02:05.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21782024-11-14T09:02:05.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21792024-11-14T09:02:05.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21802024-11-14T09:02:05.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21812024-11-14T09:02:05.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21822024-11-14T09:02:05.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21832024-11-14T09:02:05.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21842024-11-14T09:02:05.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
21852024-11-14T09:02:05.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21862024-11-14T09:02:05.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21872024-11-14T09:02:05.842ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 313.73599ms iteration = 9 status = 0
21882024-11-14T09:02:05.850ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21892024-11-14T09:02:05.850ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "be4048ae-2a3b-44c1-b533-0da9f6ed2732", "content-length": "1", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
21902024-11-14T09:02:05.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21912024-11-14T09:02:05.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21922024-11-14T09:02:05.854ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.808594ms iteration = 9 status = null
21932024-11-14T09:02:05.865ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.809011ms iteration = 9 status = {}
21942024-11-14T09:02:05.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "57f0e9a0-82ae-40be-ac3f-3ad5ebfdb1ff", "content-length": "372", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
21952024-11-14T09:02:05.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21962024-11-14T09:02:05.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21972024-11-14T09:02:05.901ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
21982024-11-14T09:02:05.902ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "12a4ad22-8652-4f30-b26b-035d9d34da44", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21992024-11-14T09:02:05.902ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22002024-11-14T09:02:05.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "762f88a9-925e-45d6-aa6e-7eda10b17f4c", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22012024-11-14T09:02:05.904ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22022024-11-14T09:02:05.907ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "96febccb-5789-4222-917b-f49e9a095104", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22032024-11-14T09:02:05.907ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22042024-11-14T09:02:05.909ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22052024-11-14T09:02:05.909ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 380.30455ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22062024-11-14T09:02:05.920ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22072024-11-14T09:02:05.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22082024-11-14T09:02:05.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22092024-11-14T09:02:05.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22102024-11-14T09:02:05.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22112024-11-14T09:02:05.976ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
22122024-11-14T09:02:05.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22132024-11-14T09:02:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22142024-11-14T09:02:05.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22152024-11-14T09:02:05.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77f9e1ff-fc53-4cf3-86f9-534717de67af", "content-length": "134", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22162024-11-14T09:02:05.986ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22172024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
22182024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22192024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22202024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22212024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22222024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22232024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22242024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22252024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22262024-11-14T09:02:05.987ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
22272024-11-14T09:02:05.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22282024-11-14T09:02:05.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22292024-11-14T09:02:05.988ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1ad9cc2e-2571-44f9-8915-824af2e7d573", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22302024-11-14T09:02:05.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22312024-11-14T09:02:05.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22322024-11-14T09:02:05.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bc42861-1515-461d-b432-0f89f4bf2f62", "content-length": "691", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22332024-11-14T09:02:05.989ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22342024-11-14T09:02:05.989ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22352024-11-14T09:02:05.989ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22362024-11-14T09:02:05.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22372024-11-14T09:02:05.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a91c1fe-940e-4dc7-824f-dccae1f07e76", "content-length": "2", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22382024-11-14T09:02:05.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22392024-11-14T09:02:05.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f08c1b9d-7cfd-4957-a470-00ccd1690a18", "content-length": "52", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22402024-11-14T09:02:05.989ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
22412024-11-14T09:02:05.989ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22422024-11-14T09:02:05.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22432024-11-14T09:02:05.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22442024-11-14T09:02:05.990ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 461.300731ms iteration = 9 status = {}
22452024-11-14T09:02:05.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22462024-11-14T09:02:05.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22472024-11-14T09:02:05.997ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22482024-11-14T09:02:05.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22492024-11-14T09:02:06.087ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8b94f6c5-aedf-4fe8-afcd-9907902b0b43", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22502024-11-14T09:02:06.087ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
22512024-11-14T09:02:06.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22522024-11-14T09:02:06.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "863c2ea1-1ab0-4cbc-a653-7aed6fec83c5", "content-length": "682", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22532024-11-14T09:02:06.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22542024-11-14T09:02:06.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22552024-11-14T09:02:06.088ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b4ea539-60e1-4f45-bdc5-4d87dca8e76a", "date": "Thu, 14 Nov 2024 09:02:05 GMT"} })
22562024-11-14T09:02:06.089ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 560.81485ms iteration = 10 status = {}
22572024-11-14T09:02:06.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22582024-11-14T09:02:06.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22592024-11-14T09:02:06.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22602024-11-14T09:02:06.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22612024-11-14T09:02:06.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22622024-11-14T09:02:06.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22632024-11-14T09:02:06.105ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 577.169673ms iteration = 9 status = {}
22642024-11-14T09:02:06.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 64d1faf3-58c1-4b2c-8ae7-c173785f3a58 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
22652024-11-14T09:02:06.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 64d1faf3-58c1-4b2c-8ae7-c173785f3a58 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
22662024-11-14T09:02:06.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 64d1faf3-58c1-4b2c-8ae7-c173785f3a58 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
22672024-11-14T09:02:06.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c7de327-7b94-4a79-bc22-495e7d718248 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22682024-11-14T09:02:06.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c7de327-7b94-4a79-bc22-495e7d718248 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22692024-11-14T09:02:06.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c7de327-7b94-4a79-bc22-495e7d718248 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22702024-11-14T09:02:07.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ed61b810-1fd7-42d5-bb23-cdc7c226b378 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22712024-11-14T09:02:07.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ed61b810-1fd7-42d5-bb23-cdc7c226b378 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22722024-11-14T09:02:07.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ed61b810-1fd7-42d5-bb23-cdc7c226b378 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22732024-11-14T09:02:08.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8890ebc5-beba-4b00-bfd0-332b3ccf3712 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22742024-11-14T09:02:08.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8890ebc5-beba-4b00-bfd0-332b3ccf3712 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22752024-11-14T09:02:08.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8890ebc5-beba-4b00-bfd0-332b3ccf3712 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22762024-11-14T09:02:09.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 059783f2-285e-41a0-8f11-eb1cd3792df8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22772024-11-14T09:02:09.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 059783f2-285e-41a0-8f11-eb1cd3792df8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22782024-11-14T09:02:09.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 059783f2-285e-41a0-8f11-eb1cd3792df8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22792024-11-14T09:02:10.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 996f081d-ac6f-4803-8182-13fd4eb6677f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22802024-11-14T09:02:10.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 996f081d-ac6f-4803-8182-13fd4eb6677f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22812024-11-14T09:02:10.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 996f081d-ac6f-4803-8182-13fd4eb6677f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22822024-11-14T09:02:11.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 16eab34d-8251-4cb4-a3d3-cefa4cd87117 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22832024-11-14T09:02:11.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 16eab34d-8251-4cb4-a3d3-cefa4cd87117 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22842024-11-14T09:02:11.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 16eab34d-8251-4cb4-a3d3-cefa4cd87117 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22852024-11-14T09:02:12.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7316ec8-269b-4148-ba85-cee43ae7a733 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22862024-11-14T09:02:12.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7316ec8-269b-4148-ba85-cee43ae7a733 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22872024-11-14T09:02:12.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7316ec8-269b-4148-ba85-cee43ae7a733 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22882024-11-14T09:02:13.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6dd8b98-7e3d-425f-85fc-1de165340f4b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22892024-11-14T09:02:13.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6dd8b98-7e3d-425f-85fc-1de165340f4b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22902024-11-14T09:02:13.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6dd8b98-7e3d-425f-85fc-1de165340f4b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22912024-11-14T09:02:14.045ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = cbdff431-a332-4dc3-a724-a3705e86464d response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
22922024-11-14T09:02:14.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80d7dcdd-aa65-4267-8d6c-593b3312c834 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22932024-11-14T09:02:14.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80d7dcdd-aa65-4267-8d6c-593b3312c834 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22942024-11-14T09:02:14.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80d7dcdd-aa65-4267-8d6c-593b3312c834 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
22952024-11-14T09:02:15.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
22962024-11-14T09:02:15.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
22972024-11-14T09:02:15.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22982024-11-14T09:02:15.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992024-11-14T09:02:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002024-11-14T09:02:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23012024-11-14T09:02:15.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23022024-11-14T09:02:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23032024-11-14T09:02:15.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23042024-11-14T09:02:15.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.891979ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23052024-11-14T09:02:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23062024-11-14T09:02:15.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23072024-11-14T09:02:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23082024-11-14T09:02:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23092024-11-14T09:02:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23102024-11-14T09:02:15.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23112024-11-14T09:02:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
23122024-11-14T09:02:15.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23132024-11-14T09:02:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23142024-11-14T09:02:15.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
23152024-11-14T09:02:15.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.186054ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
23162024-11-14T09:02:15.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e87212e5-2964-49dd-86bb-c8b92131ea37 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23172024-11-14T09:02:15.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e87212e5-2964-49dd-86bb-c8b92131ea37 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23182024-11-14T09:02:15.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e87212e5-2964-49dd-86bb-c8b92131ea37 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23192024-11-14T09:02:16.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fed0efec-9058-46f4-a996-6d7384a57c83 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23202024-11-14T09:02:16.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fed0efec-9058-46f4-a996-6d7384a57c83 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23212024-11-14T09:02:16.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fed0efec-9058-46f4-a996-6d7384a57c83 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23222024-11-14T09:02:17.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1d291535-58e7-4197-b163-6034520cbcbb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23232024-11-14T09:02:17.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1d291535-58e7-4197-b163-6034520cbcbb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23242024-11-14T09:02:17.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1d291535-58e7-4197-b163-6034520cbcbb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23252024-11-14T09:02:18.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0522710e-bb33-4d82-a6ee-7f02759b286c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23262024-11-14T09:02:18.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0522710e-bb33-4d82-a6ee-7f02759b286c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23272024-11-14T09:02:18.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0522710e-bb33-4d82-a6ee-7f02759b286c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23282024-11-14T09:02:19.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 41465bdf-1878-445e-997e-8115ca12eb81 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23292024-11-14T09:02:19.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 41465bdf-1878-445e-997e-8115ca12eb81 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23302024-11-14T09:02:19.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 41465bdf-1878-445e-997e-8115ca12eb81 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23312024-11-14T09:02:20.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2148c70-162e-4410-80bc-755f5ca3e9d8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23322024-11-14T09:02:20.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2148c70-162e-4410-80bc-755f5ca3e9d8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23332024-11-14T09:02:20.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2148c70-162e-4410-80bc-755f5ca3e9d8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23342024-11-14T09:02:21.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3748af79-ad06-4936-9b4c-7a1ee99f700f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23352024-11-14T09:02:21.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3748af79-ad06-4936-9b4c-7a1ee99f700f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23362024-11-14T09:02:22.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3748af79-ad06-4936-9b4c-7a1ee99f700f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23372024-11-14T09:02:23.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0afb4288-b1ba-4e41-b38d-15d8cdb449f9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23382024-11-14T09:02:23.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0afb4288-b1ba-4e41-b38d-15d8cdb449f9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23392024-11-14T09:02:23.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0afb4288-b1ba-4e41-b38d-15d8cdb449f9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23402024-11-14T09:02:24.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3fb6987e-6a20-4893-b38a-db3fa543e226 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23412024-11-14T09:02:24.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3fb6987e-6a20-4893-b38a-db3fa543e226 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23422024-11-14T09:02:24.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3fb6987e-6a20-4893-b38a-db3fa543e226 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23432024-11-14T09:02:25.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 357e2e4b-ab59-4539-8c72-8f3d8d55c4bf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23442024-11-14T09:02:25.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 357e2e4b-ab59-4539-8c72-8f3d8d55c4bf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23452024-11-14T09:02:25.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 357e2e4b-ab59-4539-8c72-8f3d8d55c4bf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23462024-11-14T09:02:25.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
23472024-11-14T09:02:25.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23482024-11-14T09:02:25.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
23492024-11-14T09:02:25.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23502024-11-14T09:02:25.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23512024-11-14T09:02:25.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23522024-11-14T09:02:25.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23532024-11-14T09:02:25.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23542024-11-14T09:02:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23552024-11-14T09:02:25.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.36962ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23562024-11-14T09:02:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23572024-11-14T09:02:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23582024-11-14T09:02:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23592024-11-14T09:02:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23602024-11-14T09:02:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23612024-11-14T09:02:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23622024-11-14T09:02:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
23632024-11-14T09:02:25.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23642024-11-14T09:02:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23652024-11-14T09:02:25.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
23662024-11-14T09:02:25.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.938424ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
23672024-11-14T09:02:26.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 38c66b38-0533-4dbf-8ad3-5ff74e7fed04 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23682024-11-14T09:02:26.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 38c66b38-0533-4dbf-8ad3-5ff74e7fed04 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23692024-11-14T09:02:26.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 38c66b38-0533-4dbf-8ad3-5ff74e7fed04 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23702024-11-14T09:02:27.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = adc9674c-5ff8-49bd-99cd-6efbeb7c4fc6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23712024-11-14T09:02:27.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = adc9674c-5ff8-49bd-99cd-6efbeb7c4fc6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23722024-11-14T09:02:27.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = adc9674c-5ff8-49bd-99cd-6efbeb7c4fc6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23732024-11-14T09:02:28.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cacf18ab-f76a-4813-b69d-41b3a6687521 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23742024-11-14T09:02:28.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cacf18ab-f76a-4813-b69d-41b3a6687521 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23752024-11-14T09:02:28.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cacf18ab-f76a-4813-b69d-41b3a6687521 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23762024-11-14T09:02:29.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = a7879092-8482-4493-90fd-66abca38456b response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
23772024-11-14T09:02:29.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c54c7a05-d822-4490-9080-1e4266cb7fd8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23782024-11-14T09:02:29.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c54c7a05-d822-4490-9080-1e4266cb7fd8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23792024-11-14T09:02:29.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c54c7a05-d822-4490-9080-1e4266cb7fd8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23802024-11-14T09:02:30.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af3239b9-b986-4c65-9497-994fd68e2ede roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23812024-11-14T09:02:30.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af3239b9-b986-4c65-9497-994fd68e2ede resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23822024-11-14T09:02:30.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af3239b9-b986-4c65-9497-994fd68e2ede response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23832024-11-14T09:02:31.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dc4bf0a7-c8ca-4911-9e5f-c626d6f7a615 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23842024-11-14T09:02:31.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dc4bf0a7-c8ca-4911-9e5f-c626d6f7a615 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23852024-11-14T09:02:31.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dc4bf0a7-c8ca-4911-9e5f-c626d6f7a615 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23862024-11-14T09:02:32.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5a7f302-a32d-4186-a078-fde36e05d84d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23872024-11-14T09:02:32.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5a7f302-a32d-4186-a078-fde36e05d84d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23882024-11-14T09:02:32.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5a7f302-a32d-4186-a078-fde36e05d84d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23892024-11-14T09:02:33.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3eff6997-68d6-4604-bb74-f3602628b73a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23902024-11-14T09:02:33.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3eff6997-68d6-4604-bb74-f3602628b73a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23912024-11-14T09:02:33.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3eff6997-68d6-4604-bb74-f3602628b73a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23922024-11-14T09:02:34.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9aa7e828-dc1f-4b98-8bc5-128acee81eb6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23932024-11-14T09:02:34.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9aa7e828-dc1f-4b98-8bc5-128acee81eb6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23942024-11-14T09:02:34.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9aa7e828-dc1f-4b98-8bc5-128acee81eb6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23952024-11-14T09:02:35.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fe42c126-ea5f-4a70-9c49-6a1c9c979fbc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23962024-11-14T09:02:35.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fe42c126-ea5f-4a70-9c49-6a1c9c979fbc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23972024-11-14T09:02:35.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fe42c126-ea5f-4a70-9c49-6a1c9c979fbc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
23982024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
23992024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24002024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
24012024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
24022024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24032024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
24042024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
24052024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24062024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
24072024-11-14T09:02:35.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24082024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24092024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24102024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
24112024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
24122024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24132024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24142024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24152024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
24162024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
24172024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24182024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
24192024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24202024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
24212024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24222024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
24232024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24242024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24252024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
24262024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24272024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
24282024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24292024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
24302024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24312024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
24322024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24332024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24342024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24352024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24362024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24372024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24382024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24392024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24402024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24412024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24422024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24432024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24442024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24452024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24462024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24472024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24482024-11-14T09:02:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24492024-11-14T09:02:35.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502024-11-14T09:02:35.532ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.334864ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24512024-11-14T09:02:35.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24522024-11-14T09:02:35.533ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 323214385 } })
24532024-11-14T09:02:35.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24542024-11-14T09:02:35.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24552024-11-14T09:02:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24562024-11-14T09:02:35.534ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
24572024-11-14T09:02:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24582024-11-14T09:02:35.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24592024-11-14T09:02:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24602024-11-14T09:02:35.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24612024-11-14T09:02:35.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.088736ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
24622024-11-14T09:02:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24632024-11-14T09:02:35.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24642024-11-14T09:02:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24652024-11-14T09:02:35.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662024-11-14T09:02:35.542ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24672024-11-14T09:02:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24682024-11-14T09:02:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24692024-11-14T09:02:35.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24702024-11-14T09:02:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24712024-11-14T09:02:35.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24722024-11-14T09:02:35.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 336732932 } })
24732024-11-14T09:02:35.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
24742024-11-14T09:02:35.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752024-11-14T09:02:35.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24762024-11-14T09:02:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24772024-11-14T09:02:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24782024-11-14T09:02:35.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24792024-11-14T09:02:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24802024-11-14T09:02:35.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24812024-11-14T09:02:35.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24822024-11-14T09:02:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24832024-11-14T09:02:35.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24842024-11-14T09:02:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24852024-11-14T09:02:35.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24862024-11-14T09:02:35.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872024-11-14T09:02:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24882024-11-14T09:02:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24892024-11-14T09:02:35.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24902024-11-14T09:02:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24912024-11-14T09:02:35.572ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 43.396497ms iteration = 13 status = {"physical_disks_added":0}
24922024-11-14T09:02:35.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24932024-11-14T09:02:35.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24942024-11-14T09:02:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24952024-11-14T09:02:35.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24962024-11-14T09:02:35.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24972024-11-14T09:02:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24982024-11-14T09:02:35.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.384113ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
24992024-11-14T09:02:35.588ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25002024-11-14T09:02:35.588ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25012024-11-14T09:02:35.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25022024-11-14T09:02:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25032024-11-14T09:02:35.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25042024-11-14T09:02:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25052024-11-14T09:02:35.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25062024-11-14T09:02:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25072024-11-14T09:02:35.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25082024-11-14T09:02:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25092024-11-14T09:02:35.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25102024-11-14T09:02:35.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 386896658 } })
25112024-11-14T09:02:35.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
25122024-11-14T09:02:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
25132024-11-14T09:02:35.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25142024-11-14T09:02:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25152024-11-14T09:02:35.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.00974ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25162024-11-14T09:02:35.605ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25172024-11-14T09:02:35.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.457429ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25182024-11-14T09:02:35.614ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
25192024-11-14T09:02:35.614ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.201959ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
25202024-11-14T09:02:35.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.77549ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25212024-11-14T09:02:35.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25222024-11-14T09:02:35.621ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25232024-11-14T09:02:35.622ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcd2c43e-745e-4aec-a43d-60d7101db710", "content-length": "26", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25242024-11-14T09:02:35.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25252024-11-14T09:02:35.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.723786ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25262024-11-14T09:02:35.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25272024-11-14T09:02:35.628ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25282024-11-14T09:02:35.628ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25292024-11-14T09:02:35.628ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11e60e92-d147-48b3-83d6-832f164b36b8", "content-length": "26", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25302024-11-14T09:02:35.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25312024-11-14T09:02:35.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.222997ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25322024-11-14T09:02:35.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25332024-11-14T09:02:35.631ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25342024-11-14T09:02:35.631ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25352024-11-14T09:02:35.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25362024-11-14T09:02:35.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25372024-11-14T09:02:35.633ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25382024-11-14T09:02:35.633ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25392024-11-14T09:02:35.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.455109ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25402024-11-14T09:02:35.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25412024-11-14T09:02:35.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25422024-11-14T09:02:35.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
25432024-11-14T09:02:35.698ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25442024-11-14T09:02:35.698ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86faa30c-29e2-45e1-8c04-78920c7cc356", "content-length": "26", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25452024-11-14T09:02:35.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25462024-11-14T09:02:35.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25472024-11-14T09:02:35.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25482024-11-14T09:02:35.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
25492024-11-14T09:02:35.713ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.080998ms iteration = 10 status = {}
25502024-11-14T09:02:35.723ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25512024-11-14T09:02:35.723ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f43eea43-fda6-441a-a8d4-2ada64bc48fc", "content-length": "1", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25522024-11-14T09:02:35.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25532024-11-14T09:02:35.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25542024-11-14T09:02:35.733ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25552024-11-14T09:02:35.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25562024-11-14T09:02:35.733ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9a0344a-d8f1-467c-945b-352f98ac78fb", "content-length": "372", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25572024-11-14T09:02:35.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-11-14T09:02:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25592024-11-14T09:02:35.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25602024-11-14T09:02:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25612024-11-14T09:02:35.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25622024-11-14T09:02:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25632024-11-14T09:02:35.736ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.969165ms iteration = 10 status = null
25642024-11-14T09:02:35.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25652024-11-14T09:02:35.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662024-11-14T09:02:35.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25672024-11-14T09:02:35.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25682024-11-14T09:02:35.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25692024-11-14T09:02:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
25702024-11-14T09:02:35.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25712024-11-14T09:02:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25722024-11-14T09:02:35.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25732024-11-14T09:02:35.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 213.035772ms iteration = 10 status = 0
25742024-11-14T09:02:35.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25752024-11-14T09:02:35.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25762024-11-14T09:02:35.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25772024-11-14T09:02:35.751ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25782024-11-14T09:02:35.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25792024-11-14T09:02:35.752ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d15df9d-9dab-430f-a0fb-f4c42b5bd24e", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25802024-11-14T09:02:35.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25812024-11-14T09:02:35.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25822024-11-14T09:02:35.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25832024-11-14T09:02:35.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25842024-11-14T09:02:35.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25852024-11-14T09:02:35.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25862024-11-14T09:02:35.760ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25872024-11-14T09:02:35.760ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25882024-11-14T09:02:35.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25892024-11-14T09:02:35.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25902024-11-14T09:02:35.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25912024-11-14T09:02:35.845ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
25922024-11-14T09:02:35.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25932024-11-14T09:02:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25942024-11-14T09:02:35.857ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25952024-11-14T09:02:35.857ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c1d3889-465e-48b2-aef8-40b9ee97bc16", "content-length": "134", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
25962024-11-14T09:02:35.857ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25972024-11-14T09:02:35.857ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
25982024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25992024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26002024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26012024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26022024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26032024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26042024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26052024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26062024-11-14T09:02:35.858ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
26072024-11-14T09:02:35.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26082024-11-14T09:02:35.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26092024-11-14T09:02:35.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3c763bd-3ff5-4260-8a28-a059ae001410", "content-length": "691", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
26102024-11-14T09:02:35.859ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26112024-11-14T09:02:35.859ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26122024-11-14T09:02:35.859ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26132024-11-14T09:02:35.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ca1a7ed3-ff69-459e-ac3e-ce6e2601f4b0", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
26142024-11-14T09:02:35.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26152024-11-14T09:02:35.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb4750fd-868c-4753-861e-098aa201db04", "content-length": "2", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
26162024-11-14T09:02:35.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26172024-11-14T09:02:35.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfc13161-b603-49df-bba5-3344153d13d8", "content-length": "52", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
26182024-11-14T09:02:35.861ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
26192024-11-14T09:02:35.861ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26202024-11-14T09:02:35.861ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.452912ms iteration = 10 status = {}
26212024-11-14T09:02:35.862ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 332.945099ms iteration = 11 status = {}
26222024-11-14T09:02:35.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cb57f858-24c8-449c-9a2a-abf658a8e440", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
26232024-11-14T09:02:35.952ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
26242024-11-14T09:02:35.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26252024-11-14T09:02:35.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3ecab0-e11a-4bba-9dbb-40ff461a8a37", "content-length": "682", "date": "Thu, 14 Nov 2024 09:02:35 GMT"} })
26262024-11-14T09:02:35.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26272024-11-14T09:02:35.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26282024-11-14T09:02:35.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26292024-11-14T09:02:35.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26302024-11-14T09:02:35.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26312024-11-14T09:02:35.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26322024-11-14T09:02:35.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26332024-11-14T09:02:35.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26342024-11-14T09:02:35.969ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 440.004669ms iteration = 10 status = {}
26352024-11-14T09:02:36.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 0d7140b3-0090-4d9b-b650-3e4a784ca5cb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26362024-11-14T09:02:36.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 0d7140b3-0090-4d9b-b650-3e4a784ca5cb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26372024-11-14T09:02:36.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 0d7140b3-0090-4d9b-b650-3e4a784ca5cb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26382024-11-14T09:02:36.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7a83d498-1391-49f3-a063-7f2bcae3ee29 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26392024-11-14T09:02:36.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7a83d498-1391-49f3-a063-7f2bcae3ee29 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26402024-11-14T09:02:36.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7a83d498-1391-49f3-a063-7f2bcae3ee29 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26412024-11-14T09:02:37.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e0f157f6-c60d-4bb5-a860-37e7d866345c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26422024-11-14T09:02:37.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e0f157f6-c60d-4bb5-a860-37e7d866345c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26432024-11-14T09:02:37.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e0f157f6-c60d-4bb5-a860-37e7d866345c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26442024-11-14T09:02:38.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a59049a-5fb8-444e-9898-a797cb6a9a05 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26452024-11-14T09:02:38.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a59049a-5fb8-444e-9898-a797cb6a9a05 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26462024-11-14T09:02:38.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a59049a-5fb8-444e-9898-a797cb6a9a05 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26472024-11-14T09:02:39.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 362d9485-ff82-4a6a-8821-7bfb7c4d6d53 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26482024-11-14T09:02:39.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 362d9485-ff82-4a6a-8821-7bfb7c4d6d53 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26492024-11-14T09:02:39.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 362d9485-ff82-4a6a-8821-7bfb7c4d6d53 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26502024-11-14T09:02:40.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f2f140c-9163-4fd3-8858-15b41cc453ed roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26512024-11-14T09:02:40.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f2f140c-9163-4fd3-8858-15b41cc453ed resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26522024-11-14T09:02:40.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f2f140c-9163-4fd3-8858-15b41cc453ed response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26532024-11-14T09:02:41.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e44c840f-f461-49e6-80a8-1ddac5fc6432 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26542024-11-14T09:02:41.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e44c840f-f461-49e6-80a8-1ddac5fc6432 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26552024-11-14T09:02:41.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e44c840f-f461-49e6-80a8-1ddac5fc6432 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26562024-11-14T09:02:42.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e529ecdf-9a1f-46a8-b1ba-d6732ea373ef roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26572024-11-14T09:02:42.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e529ecdf-9a1f-46a8-b1ba-d6732ea373ef resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26582024-11-14T09:02:42.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e529ecdf-9a1f-46a8-b1ba-d6732ea373ef response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26592024-11-14T09:02:43.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83d9a259-f74d-414c-8088-087372d6b962 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26602024-11-14T09:02:43.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83d9a259-f74d-414c-8088-087372d6b962 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26612024-11-14T09:02:43.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83d9a259-f74d-414c-8088-087372d6b962 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26622024-11-14T09:02:44.046ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 8b9f0146-95d2-4b71-aed5-e7b65aa84938 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
26632024-11-14T09:02:44.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e063f1e5-47ee-4c5d-82da-0cf6e4176c0e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26642024-11-14T09:02:44.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e063f1e5-47ee-4c5d-82da-0cf6e4176c0e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26652024-11-14T09:02:44.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e063f1e5-47ee-4c5d-82da-0cf6e4176c0e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26662024-11-14T09:02:45.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
26672024-11-14T09:02:45.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26682024-11-14T09:02:45.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
26692024-11-14T09:02:45.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26702024-11-14T09:02:45.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26712024-11-14T09:02:45.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26722024-11-14T09:02:45.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26732024-11-14T09:02:45.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26742024-11-14T09:02:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26752024-11-14T09:02:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26762024-11-14T09:02:45.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26772024-11-14T09:02:45.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.307135ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26782024-11-14T09:02:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26792024-11-14T09:02:45.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26802024-11-14T09:02:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26812024-11-14T09:02:45.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26822024-11-14T09:02:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
26832024-11-14T09:02:45.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26842024-11-14T09:02:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26852024-11-14T09:02:45.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
26862024-11-14T09:02:45.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.952337ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
26872024-11-14T09:02:45.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c35f023e-e006-43c0-8931-f02f1de0b2e1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26882024-11-14T09:02:45.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c35f023e-e006-43c0-8931-f02f1de0b2e1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26892024-11-14T09:02:45.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c35f023e-e006-43c0-8931-f02f1de0b2e1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26902024-11-14T09:02:46.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 45916f6c-a559-421c-90f0-86e33d226315 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26912024-11-14T09:02:46.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 45916f6c-a559-421c-90f0-86e33d226315 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26922024-11-14T09:02:46.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 45916f6c-a559-421c-90f0-86e33d226315 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26932024-11-14T09:02:47.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ac967dc-dc75-4633-8e80-4aa0030ac23a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26942024-11-14T09:02:47.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ac967dc-dc75-4633-8e80-4aa0030ac23a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26952024-11-14T09:02:47.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ac967dc-dc75-4633-8e80-4aa0030ac23a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26962024-11-14T09:02:48.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97328501-286a-4d51-a30f-492525d3a2e5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26972024-11-14T09:02:48.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97328501-286a-4d51-a30f-492525d3a2e5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26982024-11-14T09:02:48.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97328501-286a-4d51-a30f-492525d3a2e5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
26992024-11-14T09:02:49.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 56eb834d-5140-4e27-9236-0354286c07a6 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
27002024-11-14T09:02:49.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 56eb834d-5140-4e27-9236-0354286c07a6 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
27012024-11-14T09:02:49.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 56eb834d-5140-4e27-9236-0354286c07a6 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
27022024-11-14T09:02:49.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = fedbcced-33a6-4e19-ba9c-38b1f9ff4123 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
27032024-11-14T09:02:49.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = fedbcced-33a6-4e19-ba9c-38b1f9ff4123 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
27042024-11-14T09:02:49.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = fedbcced-33a6-4e19-ba9c-38b1f9ff4123 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
27052024-11-14T09:02:49.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6d509480-d71c-445a-9bba-2345bc940caf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27062024-11-14T09:02:49.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6d509480-d71c-445a-9bba-2345bc940caf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27072024-11-14T09:02:49.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6d509480-d71c-445a-9bba-2345bc940caf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27082024-11-14T09:02:50.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a11e73e9-7d20-47e2-a8f0-457dfefb07e5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27092024-11-14T09:02:50.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a11e73e9-7d20-47e2-a8f0-457dfefb07e5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27102024-11-14T09:02:50.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a11e73e9-7d20-47e2-a8f0-457dfefb07e5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27112024-11-14T09:02:51.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bb50f051-47db-45eb-87b9-b32b2fc38ce6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27122024-11-14T09:02:51.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bb50f051-47db-45eb-87b9-b32b2fc38ce6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27132024-11-14T09:02:51.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bb50f051-47db-45eb-87b9-b32b2fc38ce6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27142024-11-14T09:02:52.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0ff72bf8-e13f-42f5-af5e-d48a8dbd877b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27152024-11-14T09:02:52.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0ff72bf8-e13f-42f5-af5e-d48a8dbd877b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27162024-11-14T09:02:52.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0ff72bf8-e13f-42f5-af5e-d48a8dbd877b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27172024-11-14T09:02:53.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9566f2d-a262-4a33-bbb7-6ea49c1eb215 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27182024-11-14T09:02:53.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9566f2d-a262-4a33-bbb7-6ea49c1eb215 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27192024-11-14T09:02:53.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a9566f2d-a262-4a33-bbb7-6ea49c1eb215 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27202024-11-14T09:02:54.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a728875-82f9-4a94-98c7-69d0b93f45f2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27212024-11-14T09:02:54.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a728875-82f9-4a94-98c7-69d0b93f45f2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27222024-11-14T09:02:54.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a728875-82f9-4a94-98c7-69d0b93f45f2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27232024-11-14T09:02:55.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
27242024-11-14T09:02:55.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
27252024-11-14T09:02:55.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27262024-11-14T09:02:55.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27272024-11-14T09:02:55.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27282024-11-14T09:02:55.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27292024-11-14T09:02:55.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-11-14T09:02:55.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27312024-11-14T09:02:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27322024-11-14T09:02:55.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27332024-11-14T09:02:55.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27342024-11-14T09:02:55.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27352024-11-14T09:02:55.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.454088ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27362024-11-14T09:02:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27372024-11-14T09:02:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27382024-11-14T09:02:55.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27392024-11-14T09:02:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
27402024-11-14T09:02:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27412024-11-14T09:02:55.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27422024-11-14T09:02:55.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
27432024-11-14T09:02:55.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.556648ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
27442024-11-14T09:02:55.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e41ca350-905f-4c9e-ab5f-bde5cdd23292 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27452024-11-14T09:02:55.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e41ca350-905f-4c9e-ab5f-bde5cdd23292 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27462024-11-14T09:02:55.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e41ca350-905f-4c9e-ab5f-bde5cdd23292 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27472024-11-14T09:02:56.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c41c7c52-043a-49b2-8073-0553fdbf34d3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27482024-11-14T09:02:56.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c41c7c52-043a-49b2-8073-0553fdbf34d3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27492024-11-14T09:02:56.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c41c7c52-043a-49b2-8073-0553fdbf34d3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27502024-11-14T09:02:57.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b3f852de-e403-4e25-877e-28226344ac10 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27512024-11-14T09:02:57.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b3f852de-e403-4e25-877e-28226344ac10 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27522024-11-14T09:02:57.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b3f852de-e403-4e25-877e-28226344ac10 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27532024-11-14T09:02:58.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a7f3305-eb16-435b-990a-b09c10366cec roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27542024-11-14T09:02:58.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a7f3305-eb16-435b-990a-b09c10366cec resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27552024-11-14T09:02:58.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a7f3305-eb16-435b-990a-b09c10366cec response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27562024-11-14T09:02:59.044ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1312 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 52af91b8-837e-49d2-8dff-6824f63935a0 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
27572024-11-14T09:02:59.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 252a41fc-58d3-44b9-9e60-9e8b701c3315 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27582024-11-14T09:02:59.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 252a41fc-58d3-44b9-9e60-9e8b701c3315 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27592024-11-14T09:02:59.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 252a41fc-58d3-44b9-9e60-9e8b701c3315 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27602024-11-14T09:03:00.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92add27c-e46c-4548-92dd-192fb721941c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27612024-11-14T09:03:00.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92add27c-e46c-4548-92dd-192fb721941c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27622024-11-14T09:03:00.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92add27c-e46c-4548-92dd-192fb721941c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27632024-11-14T09:03:02.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f63c4b03-c05e-4e25-bdef-e9bbd6f4efd9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27642024-11-14T09:03:02.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f63c4b03-c05e-4e25-bdef-e9bbd6f4efd9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27652024-11-14T09:03:02.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f63c4b03-c05e-4e25-bdef-e9bbd6f4efd9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27662024-11-14T09:03:03.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a9ea02b-d878-4b07-b8f8-ab532fd6a213 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27672024-11-14T09:03:03.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a9ea02b-d878-4b07-b8f8-ab532fd6a213 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27682024-11-14T09:03:03.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a9ea02b-d878-4b07-b8f8-ab532fd6a213 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27692024-11-14T09:03:04.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 43d7cabb-1423-44fe-940d-0bb856137611 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27702024-11-14T09:03:04.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 43d7cabb-1423-44fe-940d-0bb856137611 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27712024-11-14T09:03:04.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 43d7cabb-1423-44fe-940d-0bb856137611 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27722024-11-14T09:03:05.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7516d20-93dc-49b4-b609-8031a9ad2923 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27732024-11-14T09:03:05.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7516d20-93dc-49b4-b609-8031a9ad2923 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27742024-11-14T09:03:05.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7516d20-93dc-49b4-b609-8031a9ad2923 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
27752024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
27762024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
27772024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27782024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27792024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
27802024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
27812024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27822024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
27832024-11-14T09:03:05.529ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
27842024-11-14T09:03:05.529ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:53:05.529388918 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
27852024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 27.54\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
27862024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
27872024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
27882024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
27892024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
27902024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27912024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
27922024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27932024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
27942024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
27952024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
27962024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
27972024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27982024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27992024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28002024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28012024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
28022024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28032024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
28042024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
28052024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28062024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
28072024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
28082024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28092024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28102024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28112024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
28122024-11-14T09:03:05.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28132024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28142024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
28152024-11-14T09:03:05.529ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
28162024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28172024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
28182024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28192024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
28202024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28212024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
28222024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28232024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
28242024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
28252024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28262024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
28272024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
28282024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28292024-11-14T09:03:05.529ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28302024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28312024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
28322024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28332024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28342024-11-14T09:03:05.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28352024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
28362024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
28372024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28382024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28392024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
28402024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28412024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28422024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28432024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28442024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28452024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28462024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28472024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28482024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28492024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28502024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28512024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28522024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28532024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28542024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28552024-11-14T09:03:05.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 319277951 } })
28562024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
28572024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28582024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28592024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28602024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
28612024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28622024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28632024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28642024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28652024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28662024-11-14T09:03:05.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 319482515 } })
28672024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
28682024-11-14T09:03:05.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.443354ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
28692024-11-14T09:03:05.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
28702024-11-14T09:03:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.465713ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
28712024-11-14T09:03:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28722024-11-14T09:03:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28732024-11-14T09:03:05.535ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:53:05.529388918 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
28742024-11-14T09:03:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.831174ms iteration = 6 status = {"expiration":"2024-11-14T08:53:05.529388918Z","pruned":[]}
28752024-11-14T09:03:05.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28762024-11-14T09:03:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.096488ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28772024-11-14T09:03:05.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28782024-11-14T09:03:05.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28792024-11-14T09:03:05.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 326503598 } })
28802024-11-14T09:03:05.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
28812024-11-14T09:03:05.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28822024-11-14T09:03:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28832024-11-14T09:03:05.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28842024-11-14T09:03:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28852024-11-14T09:03:05.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 328233195 } })
28862024-11-14T09:03:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28872024-11-14T09:03:05.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
28882024-11-14T09:03:05.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28892024-11-14T09:03:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28902024-11-14T09:03:05.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28912024-11-14T09:03:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28922024-11-14T09:03:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28932024-11-14T09:03:05.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28942024-11-14T09:03:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28952024-11-14T09:03:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28962024-11-14T09:03:05.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28972024-11-14T09:03:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28982024-11-14T09:03:05.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28992024-11-14T09:03:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29002024-11-14T09:03:05.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012024-11-14T09:03:05.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29022024-11-14T09:03:05.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29032024-11-14T09:03:05.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29042024-11-14T09:03:05.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.425966ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
29052024-11-14T09:03:05.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29062024-11-14T09:03:05.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29072024-11-14T09:03:05.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29082024-11-14T09:03:05.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29092024-11-14T09:03:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29102024-11-14T09:03:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29112024-11-14T09:03:05.551ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.263378ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
29122024-11-14T09:03:05.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.338614ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
29132024-11-14T09:03:05.566ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29142024-11-14T09:03:05.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152024-11-14T09:03:05.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29162024-11-14T09:03:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29172024-11-14T09:03:05.569ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29182024-11-14T09:03:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29192024-11-14T09:03:05.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29202024-11-14T09:03:05.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29212024-11-14T09:03:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29222024-11-14T09:03:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29232024-11-14T09:03:05.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29242024-11-14T09:03:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29252024-11-14T09:03:05.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 366478460 } })
29262024-11-14T09:03:05.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29272024-11-14T09:03:05.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29282024-11-14T09:03:05.578ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
29292024-11-14T09:03:05.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29302024-11-14T09:03:05.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29312024-11-14T09:03:05.579ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29322024-11-14T09:03:05.579ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.780999ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29332024-11-14T09:03:05.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29342024-11-14T09:03:05.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29352024-11-14T09:03:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29362024-11-14T09:03:05.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29372024-11-14T09:03:05.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29382024-11-14T09:03:05.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29392024-11-14T09:03:05.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29402024-11-14T09:03:05.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29412024-11-14T09:03:05.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29422024-11-14T09:03:05.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29432024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29442024-11-14T09:03:05.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29452024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29462024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29472024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29482024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29492024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29502024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29512024-11-14T09:03:05.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29522024-11-14T09:03:05.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29532024-11-14T09:03:05.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29542024-11-14T09:03:05.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
29552024-11-14T09:03:05.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29562024-11-14T09:03:05.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29572024-11-14T09:03:05.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29582024-11-14T09:03:05.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29592024-11-14T09:03:05.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29602024-11-14T09:03:05.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29612024-11-14T09:03:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29622024-11-14T09:03:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29632024-11-14T09:03:05.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29642024-11-14T09:03:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29652024-11-14T09:03:05.600ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29662024-11-14T09:03:05.600ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29672024-11-14T09:03:05.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29682024-11-14T09:03:05.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29692024-11-14T09:03:05.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702024-11-14T09:03:05.603ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
29712024-11-14T09:03:05.603ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
29722024-11-14T09:03:05.603ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.592132ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
29732024-11-14T09:03:05.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
29742024-11-14T09:03:05.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29752024-11-14T09:03:05.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29762024-11-14T09:03:05.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.964985ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29772024-11-14T09:03:05.619ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29782024-11-14T09:03:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29792024-11-14T09:03:05.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29802024-11-14T09:03:05.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29812024-11-14T09:03:05.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822024-11-14T09:03:05.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29832024-11-14T09:03:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29842024-11-14T09:03:05.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
29852024-11-14T09:03:05.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.026225ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
29862024-11-14T09:03:05.627ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29872024-11-14T09:03:05.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.34506ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29882024-11-14T09:03:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29892024-11-14T09:03:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
29902024-11-14T09:03:05.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29912024-11-14T09:03:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29922024-11-14T09:03:05.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.390657ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29932024-11-14T09:03:05.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29942024-11-14T09:03:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29952024-11-14T09:03:05.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.631157ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29962024-11-14T09:03:05.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29972024-11-14T09:03:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29982024-11-14T09:03:05.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29992024-11-14T09:03:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30002024-11-14T09:03:05.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30012024-11-14T09:03:05.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30022024-11-14T09:03:05.639ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30032024-11-14T09:03:05.639ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30042024-11-14T09:03:05.639ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30052024-11-14T09:03:05.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30062024-11-14T09:03:05.640ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30072024-11-14T09:03:05.640ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30082024-11-14T09:03:05.640ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.359824ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30092024-11-14T09:03:05.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30102024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30112024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30122024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30132024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30142024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30152024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30162024-11-14T09:03:05.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30172024-11-14T09:03:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30182024-11-14T09:03:05.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30192024-11-14T09:03:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30202024-11-14T09:03:05.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30212024-11-14T09:03:05.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30222024-11-14T09:03:05.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30232024-11-14T09:03:05.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30242024-11-14T09:03:05.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30252024-11-14T09:03:05.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30262024-11-14T09:03:05.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30272024-11-14T09:03:05.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30282024-11-14T09:03:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30292024-11-14T09:03:05.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-11-14T09:03:05.649ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30312024-11-14T09:03:05.649ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
30322024-11-14T09:03:05.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30332024-11-14T09:03:05.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30342024-11-14T09:03:05.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30352024-11-14T09:03:05.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30362024-11-14T09:03:05.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30372024-11-14T09:03:05.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
30382024-11-14T09:03:05.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30392024-11-14T09:03:05.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30402024-11-14T09:03:05.654ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30412024-11-14T09:03:05.654ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30422024-11-14T09:03:05.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.363674ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30432024-11-14T09:03:05.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30442024-11-14T09:03:05.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30452024-11-14T09:03:05.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30462024-11-14T09:03:05.655ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.884522ms iteration = 11 status = 0
30472024-11-14T09:03:05.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30482024-11-14T09:03:05.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30492024-11-14T09:03:05.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30502024-11-14T09:03:05.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30512024-11-14T09:03:05.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30522024-11-14T09:03:05.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30532024-11-14T09:03:05.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30542024-11-14T09:03:05.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30552024-11-14T09:03:05.666ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.345071ms iteration = 14 status = {"physical_disks_added":0}
30562024-11-14T09:03:05.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30572024-11-14T09:03:05.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30582024-11-14T09:03:05.669ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30592024-11-14T09:03:05.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30602024-11-14T09:03:05.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30612024-11-14T09:03:05.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30622024-11-14T09:03:05.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30632024-11-14T09:03:05.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30642024-11-14T09:03:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30652024-11-14T09:03:05.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30662024-11-14T09:03:05.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30672024-11-14T09:03:05.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
30682024-11-14T09:03:05.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30692024-11-14T09:03:05.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30702024-11-14T09:03:05.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30712024-11-14T09:03:05.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
30722024-11-14T09:03:05.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30732024-11-14T09:03:05.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30742024-11-14T09:03:05.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30752024-11-14T09:03:05.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30762024-11-14T09:03:05.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30772024-11-14T09:03:05.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30782024-11-14T09:03:05.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30792024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30802024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30812024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
30822024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
30832024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30842024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30852024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30862024-11-14T09:03:05.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
30882024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
30892024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
30902024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 163.495527ms iteration = 7 status = {"generation":2}
30912024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30922024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
30932024-11-14T09:03:05.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30942024-11-14T09:03:05.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30952024-11-14T09:03:05.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30962024-11-14T09:03:05.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30972024-11-14T09:03:05.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30982024-11-14T09:03:05.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30992024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31002024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31012024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31022024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31032024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31042024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
31052024-11-14T09:03:05.699ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 170.236015ms iteration = 7 status = {"generation":1}
31062024-11-14T09:03:05.700ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31072024-11-14T09:03:05.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31082024-11-14T09:03:05.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31092024-11-14T09:03:05.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31102024-11-14T09:03:05.708ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
31112024-11-14T09:03:05.708ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31122024-11-14T09:03:05.709ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf36d65f-d22c-4581-9cea-6f1f6864e94c", "content-length": "26", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31132024-11-14T09:03:05.709ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31142024-11-14T09:03:05.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
31152024-11-14T09:03:05.720ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31162024-11-14T09:03:05.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 191.05594ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31172024-11-14T09:03:05.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31182024-11-14T09:03:05.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31192024-11-14T09:03:05.827ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
31202024-11-14T09:03:05.827ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31212024-11-14T09:03:05.827ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "223f7a52-ef7c-4a3f-8095-9a977965b3a7", "content-length": "26", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31222024-11-14T09:03:05.827ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31232024-11-14T09:03:05.829ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31242024-11-14T09:03:05.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
31252024-11-14T09:03:05.847ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31262024-11-14T09:03:05.848ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac3d49a9-bfde-4862-a1c2-497c3dc004c9", "content-length": "26", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31272024-11-14T09:03:05.848ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31282024-11-14T09:03:05.850ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31292024-11-14T09:03:05.858ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31302024-11-14T09:03:05.858ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31312024-11-14T09:03:05.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2526c21-ff50-4f0a-b1c5-7354f3ba71c3", "content-length": "372", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31322024-11-14T09:03:05.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31332024-11-14T09:03:05.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31342024-11-14T09:03:05.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31352024-11-14T09:03:05.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31362024-11-14T09:03:05.861ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31372024-11-14T09:03:05.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31382024-11-14T09:03:05.862ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31392024-11-14T09:03:05.863ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5ebe309a-a8fc-4051-a24b-a9e9a5dab982", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31402024-11-14T09:03:05.863ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31412024-11-14T09:03:05.863ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31422024-11-14T09:03:05.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31432024-11-14T09:03:05.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31442024-11-14T09:03:05.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31452024-11-14T09:03:05.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31462024-11-14T09:03:05.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "138ac49b-8ba9-46df-84c1-e21d8807b5a3", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31472024-11-14T09:03:05.865ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31482024-11-14T09:03:05.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31492024-11-14T09:03:05.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502024-11-14T09:03:05.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31512024-11-14T09:03:05.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31522024-11-14T09:03:05.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31532024-11-14T09:03:05.868ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31542024-11-14T09:03:05.868ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 338.702472ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31552024-11-14T09:03:05.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31562024-11-14T09:03:05.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31572024-11-14T09:03:05.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31582024-11-14T09:03:05.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31592024-11-14T09:03:05.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31602024-11-14T09:03:05.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31612024-11-14T09:03:05.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31622024-11-14T09:03:05.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31632024-11-14T09:03:05.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
31642024-11-14T09:03:05.877ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31652024-11-14T09:03:05.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31662024-11-14T09:03:05.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31672024-11-14T09:03:05.880ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31682024-11-14T09:03:05.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31692024-11-14T09:03:05.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31702024-11-14T09:03:05.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31712024-11-14T09:03:05.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31722024-11-14T09:03:05.905ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
31732024-11-14T09:03:05.905ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 375.800287ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31742024-11-14T09:03:05.966ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31752024-11-14T09:03:05.966ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "79fcc0f8-7c9b-4249-864b-85fb73d00fa7", "content-length": "1", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31762024-11-14T09:03:05.968ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31772024-11-14T09:03:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31782024-11-14T09:03:05.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ec559efb-d0a3-430d-a64e-c5e0bb6be2fa", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31792024-11-14T09:03:05.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31802024-11-14T09:03:05.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31812024-11-14T09:03:06.001ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 472.248138ms iteration = 11 status = {}
31822024-11-14T09:03:06.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31832024-11-14T09:03:06.005ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3880fce8-2a12-4135-ad3d-27cbcc5930c0", "content-length": "691", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
31842024-11-14T09:03:06.005ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31852024-11-14T09:03:06.005ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31862024-11-14T09:03:06.005ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31872024-11-14T09:03:06.006ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31882024-11-14T09:03:06.006ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2aef4d28-4460-4b49-a851-b0637c3767ec", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31892024-11-14T09:03:06.006ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31902024-11-14T09:03:06.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912024-11-14T09:03:06.008ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 478.790893ms iteration = 11 status = null
31922024-11-14T09:03:06.008ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 478.475658ms iteration = 11 status = {}
31932024-11-14T09:03:06.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31942024-11-14T09:03:06.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fdeac776-74cd-400c-ae00-ec8a224e25d9", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31952024-11-14T09:03:06.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31962024-11-14T09:03:06.009ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
31972024-11-14T09:03:06.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
31982024-11-14T09:03:06.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31992024-11-14T09:03:06.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32002024-11-14T09:03:06.012ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6de3c3f9-2053-424a-a55c-eedd7754afd6", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32012024-11-14T09:03:06.012ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32022024-11-14T09:03:06.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32032024-11-14T09:03:06.014ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32042024-11-14T09:03:06.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 484.757618ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32052024-11-14T09:03:06.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32062024-11-14T09:03:06.017ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32072024-11-14T09:03:06.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32082024-11-14T09:03:06.018ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
32092024-11-14T09:03:06.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32102024-11-14T09:03:06.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32112024-11-14T09:03:06.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "37441bdf-096d-4688-9e39-b2584895760b", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32122024-11-14T09:03:06.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32132024-11-14T09:03:06.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.44351ms iteration = 12 status = {}
32142024-11-14T09:03:06.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
32152024-11-14T09:03:06.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32162024-11-14T09:03:06.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32172024-11-14T09:03:06.023ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
32182024-11-14T09:03:06.024ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
32192024-11-14T09:03:06.024ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
32202024-11-14T09:03:06.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32212024-11-14T09:03:06.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32222024-11-14T09:03:06.034ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
32232024-11-14T09:03:06.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32242024-11-14T09:03:06.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32252024-11-14T09:03:06.046ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32262024-11-14T09:03:06.046ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64c5934f-0baf-42d0-9355-288cd68fb8d2", "content-length": "134", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32272024-11-14T09:03:06.046ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32282024-11-14T09:03:06.046ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
32292024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32302024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32312024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32322024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32332024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32342024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32352024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32362024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32372024-11-14T09:03:06.047ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
32382024-11-14T09:03:06.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32392024-11-14T09:03:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32402024-11-14T09:03:06.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32412024-11-14T09:03:06.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9dd8f29-b36b-4262-bb13-8018f226251c", "content-length": "2", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32422024-11-14T09:03:06.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32432024-11-14T09:03:06.050ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0a88712-84e0-4ddc-bcc3-cd7fc881a90e", "content-length": "52", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32442024-11-14T09:03:06.050ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
32452024-11-14T09:03:06.050ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32462024-11-14T09:03:06.091ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 65d2236a-3110-4d84-aa25-77e21779db87, time_created: 2024-11-14T08:58:18.385723Z, time_modified: 2024-11-14T08:58:18.385723Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
32472024-11-14T09:03:06.091ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
32482024-11-14T09:03:06.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32492024-11-14T09:03:06.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32502024-11-14T09:03:06.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32512024-11-14T09:03:06.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32522024-11-14T09:03:06.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32532024-11-14T09:03:06.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ce1c2cde-70ff-4ad2-b8ba-165c1d6f95ff roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32542024-11-14T09:03:06.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ce1c2cde-70ff-4ad2-b8ba-165c1d6f95ff resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32552024-11-14T09:03:06.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ce1c2cde-70ff-4ad2-b8ba-165c1d6f95ff response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32562024-11-14T09:03:06.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
32572024-11-14T09:03:06.129ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32582024-11-14T09:03:06.130ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "9be8da3b-ffbc-420f-a714-f403c136e9ce", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32592024-11-14T09:03:06.131ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
32602024-11-14T09:03:06.131ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 602.082423ms
32612024-11-14T09:03:06.131ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 602.095253ms iteration = 2 status = {}
32622024-11-14T09:03:06.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "51ea2263-040e-489a-b966-7625d48eb1ee", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32632024-11-14T09:03:06.168ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
32642024-11-14T09:03:06.168ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32652024-11-14T09:03:06.169ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ba8c6a-8527-4aba-b6e1-bab9fc393cea", "content-length": "682", "date": "Thu, 14 Nov 2024 09:03:05 GMT"} })
32662024-11-14T09:03:06.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32672024-11-14T09:03:06.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32682024-11-14T09:03:06.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32692024-11-14T09:03:06.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32702024-11-14T09:03:06.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32712024-11-14T09:03:06.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32722024-11-14T09:03:06.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32732024-11-14T09:03:06.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32742024-11-14T09:03:06.187ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 658.135273ms iteration = 11 status = {}
32752024-11-14T09:03:06.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 053a70da-cadd-4b7f-afaf-b5e2d8b8e513 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32762024-11-14T09:03:06.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 053a70da-cadd-4b7f-afaf-b5e2d8b8e513 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32772024-11-14T09:03:06.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 053a70da-cadd-4b7f-afaf-b5e2d8b8e513 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32782024-11-14T09:03:07.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74030812-d61b-478d-b7bd-aa83ffc2ab72 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32792024-11-14T09:03:07.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74030812-d61b-478d-b7bd-aa83ffc2ab72 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32802024-11-14T09:03:07.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74030812-d61b-478d-b7bd-aa83ffc2ab72 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32812024-11-14T09:03:08.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f0e3b966-529b-4152-8a43-449044c6ea1f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32822024-11-14T09:03:08.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f0e3b966-529b-4152-8a43-449044c6ea1f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32832024-11-14T09:03:08.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f0e3b966-529b-4152-8a43-449044c6ea1f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32842024-11-14T09:03:08.965ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44382
32852024-11-14T09:03:08.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44382 req_id = c4f2a9cd-0998-45f8-b673-8a72cf954b05 roles = RoleSet { roles: {} } uri = /metrics/producers
32862024-11-14T09:03:08.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44382 req_id = c4f2a9cd-0998-45f8-b673-8a72cf954b05 resource = Database result = Ok(()) uri = /metrics/producers
32872024-11-14T09:03:08.982ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 90e4e05f-b4bf-4b2e-9770-f73b3d2c05fa
32882024-11-14T09:03:08.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16783 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44382 req_id = c4f2a9cd-0998-45f8-b673-8a72cf954b05 response_code = 201 uri = /metrics/producers
32892024-11-14T09:03:09.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dd57f966-5cb2-4c0a-8faf-46b878fec6ca roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32902024-11-14T09:03:09.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dd57f966-5cb2-4c0a-8faf-46b878fec6ca resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32912024-11-14T09:03:09.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dd57f966-5cb2-4c0a-8faf-46b878fec6ca response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32922024-11-14T09:03:09.679ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33767
32932024-11-14T09:03:09.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33767 req_id = 5b78147f-bfaf-4439-b383-5ed5643b057c roles = RoleSet { roles: {} } uri = /metrics/producers
32942024-11-14T09:03:09.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33767 req_id = 5b78147f-bfaf-4439-b383-5ed5643b057c resource = Database result = Ok(()) uri = /metrics/producers
32952024-11-14T09:03:09.724ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 0a0adcc5-bcdd-46d2-a222-ace3abfe409c
32962024-11-14T09:03:09.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45621 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33767 req_id = 5b78147f-bfaf-4439-b383-5ed5643b057c response_code = 201 uri = /metrics/producers
32972024-11-14T09:03:10.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 123f1c21-652f-4fe5-a17a-ed4386208d40 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32982024-11-14T09:03:10.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 123f1c21-652f-4fe5-a17a-ed4386208d40 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
32992024-11-14T09:03:10.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 123f1c21-652f-4fe5-a17a-ed4386208d40 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33002024-11-14T09:03:11.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc22a99a-61ce-405e-84ee-be3a4b887cf8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33012024-11-14T09:03:11.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc22a99a-61ce-405e-84ee-be3a4b887cf8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33022024-11-14T09:03:11.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc22a99a-61ce-405e-84ee-be3a4b887cf8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33032024-11-14T09:03:12.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8471f7e-90ee-4a1c-8325-5e7b8ad5182b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33042024-11-14T09:03:12.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8471f7e-90ee-4a1c-8325-5e7b8ad5182b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33052024-11-14T09:03:12.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8471f7e-90ee-4a1c-8325-5e7b8ad5182b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33062024-11-14T09:03:13.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 494fda6f-fede-411f-a9ea-0b469565b7f1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33072024-11-14T09:03:13.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 494fda6f-fede-411f-a9ea-0b469565b7f1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33082024-11-14T09:03:13.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 494fda6f-fede-411f-a9ea-0b469565b7f1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33092024-11-14T09:03:14.045ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1398 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 3faa72b7-3faf-4010-8b25-cb1182ee73fa response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
33102024-11-14T09:03:14.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bef27dde-2910-4a30-a033-7775c334c9ab roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33112024-11-14T09:03:14.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bef27dde-2910-4a30-a033-7775c334c9ab resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33122024-11-14T09:03:14.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bef27dde-2910-4a30-a033-7775c334c9ab response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33132024-11-14T09:03:15.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 754bb6cc-7c01-413e-ad1e-484fedc156bf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33142024-11-14T09:03:15.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 754bb6cc-7c01-413e-ad1e-484fedc156bf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33152024-11-14T09:03:15.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 754bb6cc-7c01-413e-ad1e-484fedc156bf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33162024-11-14T09:03:15.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
33172024-11-14T09:03:15.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
33182024-11-14T09:03:15.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33192024-11-14T09:03:15.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33202024-11-14T09:03:15.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33212024-11-14T09:03:15.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33222024-11-14T09:03:15.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33232024-11-14T09:03:15.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33242024-11-14T09:03:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33252024-11-14T09:03:15.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.761977ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33262024-11-14T09:03:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33272024-11-14T09:03:15.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33282024-11-14T09:03:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33292024-11-14T09:03:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33302024-11-14T09:03:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33312024-11-14T09:03:15.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322024-11-14T09:03:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
33332024-11-14T09:03:15.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33342024-11-14T09:03:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33352024-11-14T09:03:15.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
33362024-11-14T09:03:15.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.261671ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
33372024-11-14T09:03:15.647ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:46546
33382024-11-14T09:03:15.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46546 req_id = 1cf72692-a458-452e-a4df-368260792050 roles = RoleSet { roles: {} } uri = /metrics/producers
33392024-11-14T09:03:15.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46546 req_id = 1cf72692-a458-452e-a4df-368260792050 resource = Database result = Ok(()) uri = /metrics/producers
33402024-11-14T09:03:15.659ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 4ceca43a-03cf-4e69-8d70-2c7628b44304
33412024-11-14T09:03:15.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12233 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46546 req_id = 1cf72692-a458-452e-a4df-368260792050 response_code = 201 uri = /metrics/producers
33422024-11-14T09:03:16.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b31e34e-88a0-4a5c-ac01-43fd7e091248 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33432024-11-14T09:03:16.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b31e34e-88a0-4a5c-ac01-43fd7e091248 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33442024-11-14T09:03:16.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b31e34e-88a0-4a5c-ac01-43fd7e091248 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33452024-11-14T09:03:17.100ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43703
33462024-11-14T09:03:17.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43703 req_id = be649da1-f4e8-4196-9e15-bf9b0afe4110 roles = RoleSet { roles: {} } uri = /metrics/producers
33472024-11-14T09:03:17.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43703 req_id = be649da1-f4e8-4196-9e15-bf9b0afe4110 resource = Database result = Ok(()) uri = /metrics/producers
33482024-11-14T09:03:17.113ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 65d2236a-3110-4d84-aa25-77e21779db87
33492024-11-14T09:03:17.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13572 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43703 req_id = be649da1-f4e8-4196-9e15-bf9b0afe4110 response_code = 201 uri = /metrics/producers
33502024-11-14T09:03:17.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bbd85ad1-b423-4d22-b682-46f25886dbf3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33512024-11-14T09:03:17.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bbd85ad1-b423-4d22-b682-46f25886dbf3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33522024-11-14T09:03:17.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bbd85ad1-b423-4d22-b682-46f25886dbf3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33532024-11-14T09:03:18.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7b49d497-34a2-4863-a990-32d98f5db031 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33542024-11-14T09:03:18.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7b49d497-34a2-4863-a990-32d98f5db031 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33552024-11-14T09:03:18.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7b49d497-34a2-4863-a990-32d98f5db031 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33562024-11-14T09:03:18.680ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54705
33572024-11-14T09:03:18.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54705 req_id = 9cde25d2-e5a1-4bcf-bdca-70ef46058d1e roles = RoleSet { roles: {} } uri = /metrics/producers
33582024-11-14T09:03:18.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54705 req_id = 9cde25d2-e5a1-4bcf-bdca-70ef46058d1e resource = Database result = Ok(()) uri = /metrics/producers
33592024-11-14T09:03:18.698ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 92786f50-3ada-49c6-9f91-967466d8804f
33602024-11-14T09:03:18.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18034 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54705 req_id = 9cde25d2-e5a1-4bcf-bdca-70ef46058d1e response_code = 201 uri = /metrics/producers
33612024-11-14T09:03:19.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65426e0d-c5c0-4e1d-acb5-6336d7afd513 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33622024-11-14T09:03:19.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65426e0d-c5c0-4e1d-acb5-6336d7afd513 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33632024-11-14T09:03:19.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65426e0d-c5c0-4e1d-acb5-6336d7afd513 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33642024-11-14T09:03:20.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2282d7b0-ff12-4701-8c85-3a71a84d72b5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33652024-11-14T09:03:20.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2282d7b0-ff12-4701-8c85-3a71a84d72b5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33662024-11-14T09:03:20.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2282d7b0-ff12-4701-8c85-3a71a84d72b5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33672024-11-14T09:03:20.730ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40387
33682024-11-14T09:03:20.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40387 req_id = 7796d140-d189-4803-a755-17657cc3884d roles = RoleSet { roles: {} } uri = /metrics/producers
33692024-11-14T09:03:20.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40387 req_id = 7796d140-d189-4803-a755-17657cc3884d resource = Database result = Ok(()) uri = /metrics/producers
33702024-11-14T09:03:20.786ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = c91f550b-068d-4077-a493-b226555a9b58
33712024-11-14T09:03:20.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56001 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40387 req_id = 7796d140-d189-4803-a755-17657cc3884d response_code = 201 uri = /metrics/producers
33722024-11-14T09:03:21.086ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
33732024-11-14T09:03:21.086ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
33742024-11-14T09:03:21.120ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
33752024-11-14T09:03:21.120ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45327
33762024-11-14T09:03:21.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45327 req_id = 4942e7d6-2de2-4ed3-8188-ca8629573cd4 roles = RoleSet { roles: {} } uri = /metrics/producers
33772024-11-14T09:03:21.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45327 req_id = 4942e7d6-2de2-4ed3-8188-ca8629573cd4 resource = Database result = Ok(()) uri = /metrics/producers
33782024-11-14T09:03:21.165ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 484a1c50-302f-49ec-9214-2179c2ff7104
33792024-11-14T09:03:21.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45374 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45327 req_id = 4942e7d6-2de2-4ed3-8188-ca8629573cd4 response_code = 201 uri = /metrics/producers
33802024-11-14T09:03:21.166ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4942e7d6-2de2-4ed3-8188-ca8629573cd4", "content-length": "41", "date": "Thu, 14 Nov 2024 09:03:20 GMT"} })
33812024-11-14T09:03:21.168ZDEBGnexus (producer-registration-task): registered with nexus successfully
33822024-11-14T09:03:21.168ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
33832024-11-14T09:03:21.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d3e0085-baa5-4b62-92fb-655b37926362 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33842024-11-14T09:03:21.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d3e0085-baa5-4b62-92fb-655b37926362 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33852024-11-14T09:03:21.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d3e0085-baa5-4b62-92fb-655b37926362 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33862024-11-14T09:03:22.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f31406f-3ca3-40f7-aedd-913bf60c08e7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33872024-11-14T09:03:22.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f31406f-3ca3-40f7-aedd-913bf60c08e7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33882024-11-14T09:03:22.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f31406f-3ca3-40f7-aedd-913bf60c08e7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33892024-11-14T09:03:23.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baa0750e-1419-4f18-9967-98a7794ba4ba roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33902024-11-14T09:03:23.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baa0750e-1419-4f18-9967-98a7794ba4ba resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33912024-11-14T09:03:23.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baa0750e-1419-4f18-9967-98a7794ba4ba response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33922024-11-14T09:03:24.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d271916e-851d-46af-b9e9-60db7877c5be roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33932024-11-14T09:03:24.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d271916e-851d-46af-b9e9-60db7877c5be resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33942024-11-14T09:03:24.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d271916e-851d-46af-b9e9-60db7877c5be response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33952024-11-14T09:03:25.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e834e36e-fd5b-402a-b21b-7d5fbb082323 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33962024-11-14T09:03:25.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e834e36e-fd5b-402a-b21b-7d5fbb082323 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33972024-11-14T09:03:25.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e834e36e-fd5b-402a-b21b-7d5fbb082323 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
33982024-11-14T09:03:25.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
33992024-11-14T09:03:25.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
34002024-11-14T09:03:25.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34012024-11-14T09:03:25.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34022024-11-14T09:03:25.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34032024-11-14T09:03:25.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34042024-11-14T09:03:25.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34052024-11-14T09:03:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34062024-11-14T09:03:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34072024-11-14T09:03:25.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.68967ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34082024-11-14T09:03:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34092024-11-14T09:03:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34102024-11-14T09:03:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34112024-11-14T09:03:25.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34122024-11-14T09:03:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34132024-11-14T09:03:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142024-11-14T09:03:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
34152024-11-14T09:03:25.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34162024-11-14T09:03:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34172024-11-14T09:03:25.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
34182024-11-14T09:03:25.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.609358ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
34192024-11-14T09:03:26.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c5fd03cb-ced4-4e88-af32-2d8c8fad0cbe roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34202024-11-14T09:03:26.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c5fd03cb-ced4-4e88-af32-2d8c8fad0cbe resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34212024-11-14T09:03:26.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c5fd03cb-ced4-4e88-af32-2d8c8fad0cbe response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34222024-11-14T09:03:27.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e6b9b2cb-ca3d-41c7-92a6-781445a68e0a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34232024-11-14T09:03:27.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e6b9b2cb-ca3d-41c7-92a6-781445a68e0a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34242024-11-14T09:03:27.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e6b9b2cb-ca3d-41c7-92a6-781445a68e0a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34252024-11-14T09:03:28.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 373f0f2d-8102-43bf-8038-6161f2ba4a1a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34262024-11-14T09:03:28.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 373f0f2d-8102-43bf-8038-6161f2ba4a1a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34272024-11-14T09:03:28.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 373f0f2d-8102-43bf-8038-6161f2ba4a1a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34282024-11-14T09:03:29.046ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = f4793e38-a4ee-411a-b59a-01742d8e7d25 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
34292024-11-14T09:03:29.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = caa54dbd-aad7-454c-baa3-97709b02bb80 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34302024-11-14T09:03:29.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = caa54dbd-aad7-454c-baa3-97709b02bb80 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34312024-11-14T09:03:29.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = caa54dbd-aad7-454c-baa3-97709b02bb80 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34322024-11-14T09:03:30.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b32819f0-ed10-454f-b3c7-020d34f524ed roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34332024-11-14T09:03:30.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b32819f0-ed10-454f-b3c7-020d34f524ed resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34342024-11-14T09:03:30.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b32819f0-ed10-454f-b3c7-020d34f524ed response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34352024-11-14T09:03:31.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f5b8e7d-f791-4baa-af16-85bfbe37c833 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34362024-11-14T09:03:31.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f5b8e7d-f791-4baa-af16-85bfbe37c833 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34372024-11-14T09:03:31.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f5b8e7d-f791-4baa-af16-85bfbe37c833 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34382024-11-14T09:03:32.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a30a615-71f7-488e-a02a-cd9e19e57fe7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34392024-11-14T09:03:32.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a30a615-71f7-488e-a02a-cd9e19e57fe7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34402024-11-14T09:03:32.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a30a615-71f7-488e-a02a-cd9e19e57fe7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34412024-11-14T09:03:33.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 892107ed-e86f-46e7-90ec-257375f06377 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34422024-11-14T09:03:33.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 892107ed-e86f-46e7-90ec-257375f06377 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34432024-11-14T09:03:33.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 892107ed-e86f-46e7-90ec-257375f06377 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34442024-11-14T09:03:34.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05ff8f96-c958-494a-a914-6dcb14e0af71 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34452024-11-14T09:03:34.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05ff8f96-c958-494a-a914-6dcb14e0af71 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34462024-11-14T09:03:34.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05ff8f96-c958-494a-a914-6dcb14e0af71 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
34472024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
34482024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
34492024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34502024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34512024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
34522024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34532024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
34542024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
34552024-11-14T09:03:35.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34562024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
34572024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34582024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
34592024-11-14T09:03:35.530ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34602024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34612024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
34622024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34632024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
34642024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
34652024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34662024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34672024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
34682024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34692024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
34702024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
34712024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34722024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34732024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34742024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
34752024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34762024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
34772024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34782024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
34792024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34802024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
34812024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34822024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34832024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34842024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34852024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34862024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34872024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34882024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34892024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34902024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34912024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34922024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34932024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34942024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34952024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34962024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34972024-11-14T09:03:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34982024-11-14T09:03:35.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-11-14T09:03:35.533ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.683889ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35002024-11-14T09:03:35.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35012024-11-14T09:03:35.534ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 322929010 } })
35022024-11-14T09:03:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35032024-11-14T09:03:35.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35042024-11-14T09:03:35.534ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
35052024-11-14T09:03:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35062024-11-14T09:03:35.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35072024-11-14T09:03:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35082024-11-14T09:03:35.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35092024-11-14T09:03:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35102024-11-14T09:03:35.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35112024-11-14T09:03:35.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35122024-11-14T09:03:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35132024-11-14T09:03:35.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35142024-11-14T09:03:35.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35152024-11-14T09:03:35.542ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35162024-11-14T09:03:35.542ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35172024-11-14T09:03:35.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35182024-11-14T09:03:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35192024-11-14T09:03:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35202024-11-14T09:03:35.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35212024-11-14T09:03:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35222024-11-14T09:03:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35232024-11-14T09:03:35.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35242024-11-14T09:03:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35252024-11-14T09:03:35.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35262024-11-14T09:03:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35272024-11-14T09:03:35.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35282024-11-14T09:03:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35292024-11-14T09:03:35.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.885241ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
35302024-11-14T09:03:35.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35312024-11-14T09:03:35.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35322024-11-14T09:03:35.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35332024-11-14T09:03:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35342024-11-14T09:03:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35352024-11-14T09:03:35.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35362024-11-14T09:03:35.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35372024-11-14T09:03:35.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 344524987 } })
35382024-11-14T09:03:35.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
35392024-11-14T09:03:35.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35402024-11-14T09:03:35.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35412024-11-14T09:03:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35422024-11-14T09:03:35.562ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35432024-11-14T09:03:35.562ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.743706ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35442024-11-14T09:03:35.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452024-11-14T09:03:35.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35462024-11-14T09:03:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35472024-11-14T09:03:35.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35482024-11-14T09:03:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35492024-11-14T09:03:35.569ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35502024-11-14T09:03:35.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
35512024-11-14T09:03:35.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35522024-11-14T09:03:35.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35532024-11-14T09:03:35.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35542024-11-14T09:03:35.571ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35552024-11-14T09:03:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35562024-11-14T09:03:35.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35572024-11-14T09:03:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35582024-11-14T09:03:35.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.314416ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
35592024-11-14T09:03:35.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35602024-11-14T09:03:35.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
35612024-11-14T09:03:35.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.031181ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
35622024-11-14T09:03:35.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35632024-11-14T09:03:35.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35642024-11-14T09:03:35.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35652024-11-14T09:03:35.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.279335ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35662024-11-14T09:03:35.596ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35672024-11-14T09:03:35.596ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35682024-11-14T09:03:35.597ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "816c1408-ff87-4965-8906-81b4a760fa22", "content-length": "26", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
35692024-11-14T09:03:35.597ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35702024-11-14T09:03:35.598ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35712024-11-14T09:03:35.603ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35722024-11-14T09:03:35.603ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35732024-11-14T09:03:35.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35742024-11-14T09:03:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35752024-11-14T09:03:35.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.458556ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35762024-11-14T09:03:35.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.953045ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35772024-11-14T09:03:35.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.106937ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35782024-11-14T09:03:35.616ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
35792024-11-14T09:03:35.616ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35802024-11-14T09:03:35.616ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0ec8437-6ba5-4ac5-95c6-e220afee8857", "content-length": "26", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
35812024-11-14T09:03:35.616ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35822024-11-14T09:03:35.618ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
35832024-11-14T09:03:35.625ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 413955503 } })
35842024-11-14T09:03:35.625ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
35852024-11-14T09:03:35.636ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35862024-11-14T09:03:35.636ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35872024-11-14T09:03:35.636ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.225747ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35882024-11-14T09:03:35.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35892024-11-14T09:03:35.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35902024-11-14T09:03:35.681ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.565765ms iteration = 15 status = {"physical_disks_added":0}
35912024-11-14T09:03:35.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35922024-11-14T09:03:35.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35932024-11-14T09:03:35.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35942024-11-14T09:03:35.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35952024-11-14T09:03:35.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962024-11-14T09:03:35.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
35972024-11-14T09:03:35.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35982024-11-14T09:03:35.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35992024-11-14T09:03:35.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36002024-11-14T09:03:35.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36012024-11-14T09:03:35.716ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 186.607238ms iteration = 12 status = 0
36022024-11-14T09:03:35.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032024-11-14T09:03:35.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36042024-11-14T09:03:35.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36052024-11-14T09:03:35.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36062024-11-14T09:03:35.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072024-11-14T09:03:35.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36082024-11-14T09:03:35.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36092024-11-14T09:03:35.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36102024-11-14T09:03:35.736ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.688491ms iteration = 12 status = {}
36112024-11-14T09:03:35.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
36122024-11-14T09:03:35.745ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36132024-11-14T09:03:35.746ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ae31ef8-4ec4-4d79-a31b-8f33569ad40d", "content-length": "26", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36142024-11-14T09:03:35.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36152024-11-14T09:03:35.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36162024-11-14T09:03:35.786ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36172024-11-14T09:03:35.786ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36182024-11-14T09:03:35.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a0765e88-c1b4-4f8c-91de-7c7469969270 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36192024-11-14T09:03:35.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a0765e88-c1b4-4f8c-91de-7c7469969270 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36202024-11-14T09:03:35.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "98df652b-e45a-4012-ab23-25936776001c", "content-length": "372", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36212024-11-14T09:03:35.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36222024-11-14T09:03:35.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36232024-11-14T09:03:35.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a0765e88-c1b4-4f8c-91de-7c7469969270 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36242024-11-14T09:03:35.813ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36252024-11-14T09:03:35.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5423a43f-b6b5-4591-94f5-dfca18483461", "content-length": "691", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36262024-11-14T09:03:35.815ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
36272024-11-14T09:03:35.815ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
36282024-11-14T09:03:35.815ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
36292024-11-14T09:03:35.817ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.452428ms iteration = 12 status = {}
36302024-11-14T09:03:35.820ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36312024-11-14T09:03:35.820ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36322024-11-14T09:03:35.820ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c27a3aac-ad27-41b1-9bc1-87418ec63a0b", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36332024-11-14T09:03:35.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36342024-11-14T09:03:35.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36352024-11-14T09:03:35.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36362024-11-14T09:03:35.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36372024-11-14T09:03:35.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36382024-11-14T09:03:35.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36392024-11-14T09:03:35.829ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36402024-11-14T09:03:35.829ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "128f6a33-b02a-4f5f-88c2-dd425f20e433", "content-length": "1", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36412024-11-14T09:03:35.829ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36422024-11-14T09:03:35.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36432024-11-14T09:03:35.831ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36442024-11-14T09:03:35.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36452024-11-14T09:03:35.833ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 303.930573ms iteration = 12 status = null
36462024-11-14T09:03:35.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36472024-11-14T09:03:35.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36482024-11-14T09:03:35.854ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
36492024-11-14T09:03:35.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36502024-11-14T09:03:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36512024-11-14T09:03:35.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36522024-11-14T09:03:35.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff89a307-6c10-49df-9910-ffc5bc967a96", "content-length": "134", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36532024-11-14T09:03:35.863ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36542024-11-14T09:03:35.863ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
36552024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36562024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36572024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36582024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36592024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36602024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36612024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36622024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36632024-11-14T09:03:35.864ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
36642024-11-14T09:03:35.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36652024-11-14T09:03:35.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36662024-11-14T09:03:35.866ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36672024-11-14T09:03:35.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "158193f9-ad17-4965-876e-866ababdce76", "content-length": "2", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36682024-11-14T09:03:35.866ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36692024-11-14T09:03:35.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0887bc4c-8db6-43d4-a80b-9ef9efe3f429", "content-length": "52", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36702024-11-14T09:03:35.866ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
36712024-11-14T09:03:35.866ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36722024-11-14T09:03:35.924ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4404558c-0912-4cb0-a5a1-5e111ffcdcf8", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36732024-11-14T09:03:35.925ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.776678ms iteration = 13 status = {}
36742024-11-14T09:03:36.023ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "005149c5-a954-49ab-87cb-6ac892835c89", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36752024-11-14T09:03:36.024ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
36762024-11-14T09:03:36.024ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36772024-11-14T09:03:36.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9600930-d2b0-49c3-af48-1c13ceb0ae20", "content-length": "682", "date": "Thu, 14 Nov 2024 09:03:35 GMT"} })
36782024-11-14T09:03:36.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36792024-11-14T09:03:36.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36802024-11-14T09:03:36.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36812024-11-14T09:03:36.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36822024-11-14T09:03:36.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36832024-11-14T09:03:36.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36842024-11-14T09:03:36.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36852024-11-14T09:03:36.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36862024-11-14T09:03:36.044ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 514.930623ms iteration = 12 status = {}
36872024-11-14T09:03:36.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 80e2ce87-95eb-47be-a127-c3912ad7f900 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36882024-11-14T09:03:36.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 80e2ce87-95eb-47be-a127-c3912ad7f900 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36892024-11-14T09:03:36.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 80e2ce87-95eb-47be-a127-c3912ad7f900 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36902024-11-14T09:03:36.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95f5f16e-3670-40e3-9aa9-db6ad17cd8f7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36912024-11-14T09:03:36.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95f5f16e-3670-40e3-9aa9-db6ad17cd8f7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36922024-11-14T09:03:36.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95f5f16e-3670-40e3-9aa9-db6ad17cd8f7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36932024-11-14T09:03:37.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8e4ccc86-3704-4ba9-9176-bb587e8e0190 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36942024-11-14T09:03:37.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8e4ccc86-3704-4ba9-9176-bb587e8e0190 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36952024-11-14T09:03:37.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8e4ccc86-3704-4ba9-9176-bb587e8e0190 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36962024-11-14T09:03:38.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 70bb8c3d-9d89-4cae-96a3-b948e6329b36 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36972024-11-14T09:03:38.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 70bb8c3d-9d89-4cae-96a3-b948e6329b36 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36982024-11-14T09:03:38.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 70bb8c3d-9d89-4cae-96a3-b948e6329b36 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
36992024-11-14T09:03:39.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a3d724e-db66-4010-b065-50693ab6d43c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37002024-11-14T09:03:39.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a3d724e-db66-4010-b065-50693ab6d43c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37012024-11-14T09:03:39.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a3d724e-db66-4010-b065-50693ab6d43c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37022024-11-14T09:03:40.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68ba91a0-8b77-4c55-94f2-28e9db7721d5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37032024-11-14T09:03:40.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68ba91a0-8b77-4c55-94f2-28e9db7721d5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37042024-11-14T09:03:40.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68ba91a0-8b77-4c55-94f2-28e9db7721d5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37052024-11-14T09:03:41.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cf1eb48a-b0c2-4e08-96b0-7896b393ae62 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37062024-11-14T09:03:41.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cf1eb48a-b0c2-4e08-96b0-7896b393ae62 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37072024-11-14T09:03:41.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cf1eb48a-b0c2-4e08-96b0-7896b393ae62 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37082024-11-14T09:03:42.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 99ad687e-a920-401c-b9df-e40e8191c9e1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37092024-11-14T09:03:42.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 99ad687e-a920-401c-b9df-e40e8191c9e1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37102024-11-14T09:03:42.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 99ad687e-a920-401c-b9df-e40e8191c9e1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37112024-11-14T09:03:43.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d415778e-bf23-4628-8005-a9604f6d1793 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37122024-11-14T09:03:43.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d415778e-bf23-4628-8005-a9604f6d1793 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37132024-11-14T09:03:43.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d415778e-bf23-4628-8005-a9604f6d1793 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37142024-11-14T09:03:44.048ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = f8dd1d2a-e807-41ea-885c-5930fe3f20f6 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
37152024-11-14T09:03:45.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7effa158-404b-4b1d-ae99-d77c7106e431 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37162024-11-14T09:03:45.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7effa158-404b-4b1d-ae99-d77c7106e431 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37172024-11-14T09:03:45.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7effa158-404b-4b1d-ae99-d77c7106e431 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37182024-11-14T09:03:45.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
37192024-11-14T09:03:45.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
37202024-11-14T09:03:45.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37212024-11-14T09:03:45.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-11-14T09:03:45.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-11-14T09:03:45.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37242024-11-14T09:03:45.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252024-11-14T09:03:45.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37262024-11-14T09:03:45.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37272024-11-14T09:03:45.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.400561ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37282024-11-14T09:03:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37292024-11-14T09:03:45.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37302024-11-14T09:03:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37312024-11-14T09:03:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37322024-11-14T09:03:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37332024-11-14T09:03:45.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37342024-11-14T09:03:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
37352024-11-14T09:03:45.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37362024-11-14T09:03:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37372024-11-14T09:03:45.547ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
37382024-11-14T09:03:45.547ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.65276ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
37392024-11-14T09:03:46.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e9756693-128d-4309-bf81-a5be9d461b54 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37402024-11-14T09:03:46.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e9756693-128d-4309-bf81-a5be9d461b54 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37412024-11-14T09:03:46.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e9756693-128d-4309-bf81-a5be9d461b54 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37422024-11-14T09:03:47.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a69e211-c160-4a75-ad5a-95364e819a1e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37432024-11-14T09:03:47.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a69e211-c160-4a75-ad5a-95364e819a1e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37442024-11-14T09:03:47.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a69e211-c160-4a75-ad5a-95364e819a1e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37452024-11-14T09:03:48.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae10d74-5a52-428c-b9b2-4492f3806099 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37462024-11-14T09:03:48.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae10d74-5a52-428c-b9b2-4492f3806099 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37472024-11-14T09:03:48.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae10d74-5a52-428c-b9b2-4492f3806099 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37482024-11-14T09:03:49.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 4dbbb0b4-a809-440c-8344-5e910f0d870f roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
37492024-11-14T09:03:49.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 4dbbb0b4-a809-440c-8344-5e910f0d870f resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
37502024-11-14T09:03:49.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 4dbbb0b4-a809-440c-8344-5e910f0d870f response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
37512024-11-14T09:03:49.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b6de826c-271b-4a9d-b2d4-ce2545b843eb roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
37522024-11-14T09:03:49.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b6de826c-271b-4a9d-b2d4-ce2545b843eb resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
37532024-11-14T09:03:49.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = b6de826c-271b-4a9d-b2d4-ce2545b843eb response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
37542024-11-14T09:03:49.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cd83755d-dce1-4218-9bc6-47e49dfe8623 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37552024-11-14T09:03:49.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cd83755d-dce1-4218-9bc6-47e49dfe8623 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37562024-11-14T09:03:49.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cd83755d-dce1-4218-9bc6-47e49dfe8623 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37572024-11-14T09:03:50.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b991745c-789f-4bca-adb0-22d30eb6ab5f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37582024-11-14T09:03:50.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b991745c-789f-4bca-adb0-22d30eb6ab5f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37592024-11-14T09:03:50.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b991745c-789f-4bca-adb0-22d30eb6ab5f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37602024-11-14T09:03:51.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fd7dce52-e52c-4a22-b43e-430ace19517e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37612024-11-14T09:03:51.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fd7dce52-e52c-4a22-b43e-430ace19517e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37622024-11-14T09:03:51.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fd7dce52-e52c-4a22-b43e-430ace19517e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37632024-11-14T09:03:52.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 330e4c9a-0ffe-4861-8117-c51fd9a4a30e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37642024-11-14T09:03:52.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 330e4c9a-0ffe-4861-8117-c51fd9a4a30e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37652024-11-14T09:03:52.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 330e4c9a-0ffe-4861-8117-c51fd9a4a30e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37662024-11-14T09:03:53.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d72a147f-a621-45c7-bb0b-95a322287478 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37672024-11-14T09:03:53.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d72a147f-a621-45c7-bb0b-95a322287478 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37682024-11-14T09:03:53.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d72a147f-a621-45c7-bb0b-95a322287478 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37692024-11-14T09:03:54.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 13effa0b-e5e5-4c87-a939-317dc50ed47b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37702024-11-14T09:03:54.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 13effa0b-e5e5-4c87-a939-317dc50ed47b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37712024-11-14T09:03:54.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 13effa0b-e5e5-4c87-a939-317dc50ed47b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37722024-11-14T09:03:55.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b13e04f8-09de-40a3-8817-20963e2b9258 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37732024-11-14T09:03:55.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b13e04f8-09de-40a3-8817-20963e2b9258 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37742024-11-14T09:03:55.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b13e04f8-09de-40a3-8817-20963e2b9258 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37752024-11-14T09:03:55.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
37762024-11-14T09:03:55.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
37772024-11-14T09:03:55.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37782024-11-14T09:03:55.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37792024-11-14T09:03:55.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37802024-11-14T09:03:55.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37812024-11-14T09:03:55.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37822024-11-14T09:03:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37832024-11-14T09:03:55.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842024-11-14T09:03:55.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.716529ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37852024-11-14T09:03:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37862024-11-14T09:03:55.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37872024-11-14T09:03:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37882024-11-14T09:03:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892024-11-14T09:03:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37902024-11-14T09:03:55.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37912024-11-14T09:03:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
37922024-11-14T09:03:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37932024-11-14T09:03:55.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37942024-11-14T09:03:55.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
37952024-11-14T09:03:55.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.377968ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
37962024-11-14T09:03:56.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2a983a74-9300-4ecf-a9df-a8eb8fa47bb9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37972024-11-14T09:03:56.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2a983a74-9300-4ecf-a9df-a8eb8fa47bb9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37982024-11-14T09:03:56.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2a983a74-9300-4ecf-a9df-a8eb8fa47bb9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
37992024-11-14T09:03:57.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7ced2d2-88a4-46af-9cb1-01d9ca60be22 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38002024-11-14T09:03:57.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7ced2d2-88a4-46af-9cb1-01d9ca60be22 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38012024-11-14T09:03:57.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7ced2d2-88a4-46af-9cb1-01d9ca60be22 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38022024-11-14T09:03:58.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 747ffc65-e24e-4087-91f4-e74188512cc6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38032024-11-14T09:03:58.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 747ffc65-e24e-4087-91f4-e74188512cc6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38042024-11-14T09:03:58.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 747ffc65-e24e-4087-91f4-e74188512cc6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38052024-11-14T09:03:59.046ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 3b44dc1e-eced-4464-a299-b646319dd04f response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
38062024-11-14T09:03:59.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7def846-6183-4258-b339-900272122e8f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38072024-11-14T09:03:59.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7def846-6183-4258-b339-900272122e8f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38082024-11-14T09:03:59.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c7def846-6183-4258-b339-900272122e8f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38092024-11-14T09:04:00.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cf5b20ac-35f4-4d1f-bf26-434be17a272c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38102024-11-14T09:04:00.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cf5b20ac-35f4-4d1f-bf26-434be17a272c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38112024-11-14T09:04:00.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cf5b20ac-35f4-4d1f-bf26-434be17a272c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38122024-11-14T09:04:01.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a46f73a-50e1-490e-a06b-14dee122ff0b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38132024-11-14T09:04:01.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a46f73a-50e1-490e-a06b-14dee122ff0b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38142024-11-14T09:04:01.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a46f73a-50e1-490e-a06b-14dee122ff0b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38152024-11-14T09:04:02.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b044578-f55c-4cb8-96c9-86fc4d1f9563 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38162024-11-14T09:04:02.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b044578-f55c-4cb8-96c9-86fc4d1f9563 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38172024-11-14T09:04:02.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b044578-f55c-4cb8-96c9-86fc4d1f9563 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38182024-11-14T09:04:03.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 53162c13-e120-4fc9-904c-c7b46a29c1ec roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38192024-11-14T09:04:03.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 53162c13-e120-4fc9-904c-c7b46a29c1ec resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38202024-11-14T09:04:03.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 53162c13-e120-4fc9-904c-c7b46a29c1ec response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38212024-11-14T09:04:04.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = df41cc3a-edd4-415b-9292-c1af6c9f9ec1 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
38222024-11-14T09:04:04.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = df41cc3a-edd4-415b-9292-c1af6c9f9ec1 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
38232024-11-14T09:04:04.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = df41cc3a-edd4-415b-9292-c1af6c9f9ec1 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
38242024-11-14T09:04:04.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 10bb5a9c-d639-4ebb-ac48-182967775472 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
38252024-11-14T09:04:04.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 10bb5a9c-d639-4ebb-ac48-182967775472 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
38262024-11-14T09:04:04.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 10bb5a9c-d639-4ebb-ac48-182967775472 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
38272024-11-14T09:04:04.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1683bc5-e07b-496f-9783-4d3e9d1bdc7f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38282024-11-14T09:04:04.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1683bc5-e07b-496f-9783-4d3e9d1bdc7f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38292024-11-14T09:04:04.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1683bc5-e07b-496f-9783-4d3e9d1bdc7f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38302024-11-14T09:04:05.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f42d9a9-84f1-4542-8607-75f02ce03599 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38312024-11-14T09:04:05.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f42d9a9-84f1-4542-8607-75f02ce03599 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38322024-11-14T09:04:05.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f42d9a9-84f1-4542-8607-75f02ce03599 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
38332024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
38342024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38352024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
38362024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
38372024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
38382024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38392024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38402024-11-14T09:04:05.529ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:54:05.529509509 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38412024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38422024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
38432024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38442024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
38452024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38462024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
38472024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38482024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38492024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
38502024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
38512024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38522024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
38532024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38542024-11-14T09:04:05.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38552024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38562024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
38572024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
38582024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38592024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
38602024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38612024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38622024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
38632024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
38642024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38652024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38662024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
38672024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38682024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
38692024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
38702024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
38712024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38722024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
38732024-11-14T09:04:05.529ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
38742024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
38752024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
38762024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.151\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
38772024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
38782024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38792024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
38802024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38812024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38822024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
38832024-11-14T09:04:05.529ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38842024-11-14T09:04:05.529ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38852024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38862024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38872024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38882024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38892024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38902024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38912024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38922024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38932024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38942024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38952024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38962024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38972024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38982024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38992024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39002024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39012024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39022024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39032024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
39042024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39052024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
39062024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39072024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
39082024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
39092024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39102024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39112024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39122024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
39132024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39142024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39152024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
39162024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39172024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39182024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39192024-11-14T09:04:05.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 318799494 } })
39202024-11-14T09:04:05.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 318802864 } })
39212024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39222024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39232024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39242024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39252024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39262024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39272024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39282024-11-14T09:04:05.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39292024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39302024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39312024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39322024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.425223ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39332024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39342024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.541534ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39352024-11-14T09:04:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39362024-11-14T09:04:05.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39372024-11-14T09:04:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39382024-11-14T09:04:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.88811ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39392024-11-14T09:04:05.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39402024-11-14T09:04:05.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39412024-11-14T09:04:05.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422024-11-14T09:04:05.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39432024-11-14T09:04:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39442024-11-14T09:04:05.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39452024-11-14T09:04:05.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39462024-11-14T09:04:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39472024-11-14T09:04:05.540ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:54:05.529509509 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39482024-11-14T09:04:05.540ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.491659ms iteration = 7 status = {"expiration":"2024-11-14T08:54:05.529509509Z","pruned":[]}
39492024-11-14T09:04:05.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39502024-11-14T09:04:05.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39512024-11-14T09:04:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39522024-11-14T09:04:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39532024-11-14T09:04:05.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39542024-11-14T09:04:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39552024-11-14T09:04:05.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39562024-11-14T09:04:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39572024-11-14T09:04:05.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 332012576 } })
39582024-11-14T09:04:05.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
39592024-11-14T09:04:05.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39602024-11-14T09:04:05.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39612024-11-14T09:04:05.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39622024-11-14T09:04:05.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39632024-11-14T09:04:05.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39642024-11-14T09:04:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39652024-11-14T09:04:05.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 333372768 } })
39662024-11-14T09:04:05.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
39672024-11-14T09:04:05.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39682024-11-14T09:04:05.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39692024-11-14T09:04:05.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39702024-11-14T09:04:05.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39712024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39722024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39732024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39742024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39752024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39762024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39772024-11-14T09:04:05.549ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39782024-11-14T09:04:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39792024-11-14T09:04:05.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39802024-11-14T09:04:05.551ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39812024-11-14T09:04:05.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39822024-11-14T09:04:05.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39832024-11-14T09:04:05.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39842024-11-14T09:04:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39852024-11-14T09:04:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39862024-11-14T09:04:05.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39872024-11-14T09:04:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39882024-11-14T09:04:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39892024-11-14T09:04:05.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39902024-11-14T09:04:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39912024-11-14T09:04:05.555ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39922024-11-14T09:04:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39932024-11-14T09:04:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39942024-11-14T09:04:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39952024-11-14T09:04:05.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39962024-11-14T09:04:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39972024-11-14T09:04:05.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 26.595147ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
39982024-11-14T09:04:05.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39992024-11-14T09:04:05.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40002024-11-14T09:04:05.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40012024-11-14T09:04:05.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40022024-11-14T09:04:05.559ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 28.582809ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
40032024-11-14T09:04:05.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-11-14T09:04:05.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 29.355921ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
40052024-11-14T09:04:05.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40062024-11-14T09:04:05.561ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40072024-11-14T09:04:05.561ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40082024-11-14T09:04:05.561ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 31.337984ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40092024-11-14T09:04:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40102024-11-14T09:04:05.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40112024-11-14T09:04:05.562ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40122024-11-14T09:04:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40132024-11-14T09:04:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40142024-11-14T09:04:05.562ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40162024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40172024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40182024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40192024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.670105ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40222024-11-14T09:04:05.567ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40232024-11-14T09:04:05.568ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40242024-11-14T09:04:05.568ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40252024-11-14T09:04:05.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40262024-11-14T09:04:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40272024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40282024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40292024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40302024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40312024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40322024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40332024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40342024-11-14T09:04:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40352024-11-14T09:04:05.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-11-14T09:04:05.572ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40372024-11-14T09:04:05.572ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40382024-11-14T09:04:05.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40392024-11-14T09:04:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40402024-11-14T09:04:05.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40412024-11-14T09:04:05.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40422024-11-14T09:04:05.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40432024-11-14T09:04:05.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40442024-11-14T09:04:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40452024-11-14T09:04:05.578ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40462024-11-14T09:04:05.578ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.57207ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40472024-11-14T09:04:05.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40482024-11-14T09:04:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40492024-11-14T09:04:05.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.027133ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40502024-11-14T09:04:05.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40512024-11-14T09:04:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40522024-11-14T09:04:05.581ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 369453318 } })
40532024-11-14T09:04:05.581ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
40542024-11-14T09:04:05.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40552024-11-14T09:04:05.583ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 53.784254ms iteration = 4 status = {"nsuccess":5}
40562024-11-14T09:04:05.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40572024-11-14T09:04:05.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582024-11-14T09:04:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40592024-11-14T09:04:05.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40602024-11-14T09:04:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40612024-11-14T09:04:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40622024-11-14T09:04:05.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40632024-11-14T09:04:05.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40642024-11-14T09:04:05.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40652024-11-14T09:04:05.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40662024-11-14T09:04:05.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672024-11-14T09:04:05.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40682024-11-14T09:04:05.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40692024-11-14T09:04:05.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.14271ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40702024-11-14T09:04:05.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40712024-11-14T09:04:05.590ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40722024-11-14T09:04:05.590ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
40732024-11-14T09:04:05.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40742024-11-14T09:04:05.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40752024-11-14T09:04:05.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
40762024-11-14T09:04:05.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40772024-11-14T09:04:05.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40782024-11-14T09:04:05.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40792024-11-14T09:04:05.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40802024-11-14T09:04:05.616ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40812024-11-14T09:04:05.616ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40822024-11-14T09:04:05.616ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.49035ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40832024-11-14T09:04:05.618ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40842024-11-14T09:04:05.618ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40852024-11-14T09:04:05.618ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.753926ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40862024-11-14T09:04:05.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.199949ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40872024-11-14T09:04:05.625ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40882024-11-14T09:04:05.625ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40892024-11-14T09:04:05.625ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40902024-11-14T09:04:05.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40912024-11-14T09:04:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40922024-11-14T09:04:05.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40932024-11-14T09:04:05.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40942024-11-14T09:04:05.653ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40952024-11-14T09:04:05.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 124.093064ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40962024-11-14T09:04:05.685ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40972024-11-14T09:04:05.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
40982024-11-14T09:04:05.694ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40992024-11-14T09:04:05.695ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2da4dfca-4955-4113-9cd9-530eaf89ae65", "content-length": "26", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41002024-11-14T09:04:05.695ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41012024-11-14T09:04:05.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41022024-11-14T09:04:05.708ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
41032024-11-14T09:04:05.708ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41042024-11-14T09:04:05.708ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f13ae61-dee5-4755-8b52-c30090f06677", "content-length": "26", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41052024-11-14T09:04:05.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41062024-11-14T09:04:05.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41072024-11-14T09:04:05.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
41082024-11-14T09:04:05.739ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41092024-11-14T09:04:05.740ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee4f71bb-e138-4f0b-a422-3de4f2b74ddc", "content-length": "26", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41102024-11-14T09:04:05.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41112024-11-14T09:04:05.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
41122024-11-14T09:04:05.753ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41132024-11-14T09:04:05.862ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.736236ms iteration = 13 status = {}
41142024-11-14T09:04:05.867ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41152024-11-14T09:04:05.970ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41162024-11-14T09:04:05.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41172024-11-14T09:04:05.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e02d793b-0931-4f05-add4-a32b3fb666dc", "content-length": "372", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41182024-11-14T09:04:05.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41192024-11-14T09:04:05.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41202024-11-14T09:04:05.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41212024-11-14T09:04:05.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41222024-11-14T09:04:05.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41232024-11-14T09:04:05.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41242024-11-14T09:04:05.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41252024-11-14T09:04:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41262024-11-14T09:04:05.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41272024-11-14T09:04:05.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-11-14T09:04:05.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41292024-11-14T09:04:05.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41302024-11-14T09:04:05.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41312024-11-14T09:04:05.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41322024-11-14T09:04:05.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41332024-11-14T09:04:05.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41342024-11-14T09:04:05.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41352024-11-14T09:04:05.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41362024-11-14T09:04:05.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41372024-11-14T09:04:05.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41382024-11-14T09:04:05.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41392024-11-14T09:04:05.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
41402024-11-14T09:04:05.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41412024-11-14T09:04:05.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
41422024-11-14T09:04:05.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 457.505991ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
41432024-11-14T09:04:05.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41442024-11-14T09:04:05.988ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 459.281719ms iteration = 13 status = 0
41452024-11-14T09:04:05.991ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41462024-11-14T09:04:05.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41472024-11-14T09:04:05.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "beae8655-1285-468b-98d1-836f00fab17c", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41482024-11-14T09:04:05.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41492024-11-14T09:04:05.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41502024-11-14T09:04:05.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41512024-11-14T09:04:05.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41522024-11-14T09:04:05.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41532024-11-14T09:04:05.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41542024-11-14T09:04:06.000ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41552024-11-14T09:04:06.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41562024-11-14T09:04:06.010ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "73e9c70d-0f35-444d-bd09-f48a9d53ec6d", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41572024-11-14T09:04:06.012ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 483.053701ms iteration = 14 status = {}
41582024-11-14T09:04:06.014ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41592024-11-14T09:04:06.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41602024-11-14T09:04:06.014ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9b6bff30-d21d-420b-ab63-2f7cc8e47ecb", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41612024-11-14T09:04:06.015ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41622024-11-14T09:04:06.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5e4cfd47-4824-49ad-bd48-0f5641ad95ca", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41632024-11-14T09:04:06.017ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41642024-11-14T09:04:06.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41652024-11-14T09:04:06.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41662024-11-14T09:04:06.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41672024-11-14T09:04:06.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c06762a1-343d-4798-a7b0-9a3a1e38ed6b", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41682024-11-14T09:04:06.019ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41692024-11-14T09:04:06.019ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
41702024-11-14T09:04:06.019ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41712024-11-14T09:04:06.019ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
41722024-11-14T09:04:06.019ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 490.329247ms iteration = 8 status = {"generation":2}
41732024-11-14T09:04:06.021ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41742024-11-14T09:04:06.021ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 492.089956ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41752024-11-14T09:04:06.023ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41762024-11-14T09:04:06.023ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41772024-11-14T09:04:06.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41782024-11-14T09:04:06.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41792024-11-14T09:04:06.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802024-11-14T09:04:06.026ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 496.797912ms iteration = 16 status = {"physical_disks_added":0}
41812024-11-14T09:04:06.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41822024-11-14T09:04:06.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41832024-11-14T09:04:06.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41842024-11-14T09:04:06.031ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
41852024-11-14T09:04:06.031ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 501.929974ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41862024-11-14T09:04:06.032ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41872024-11-14T09:04:06.032ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41882024-11-14T09:04:06.032ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
41892024-11-14T09:04:06.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 502.879719ms iteration = 8 status = {"generation":1}
41902024-11-14T09:04:06.069ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41912024-11-14T09:04:06.070ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cefa9781-3652-43ab-a148-6c57a9be433a", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41922024-11-14T09:04:06.070ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41932024-11-14T09:04:06.072ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f945cbb0-15c7-4ca0-abf7-10667a3431ba", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41942024-11-14T09:04:06.072ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41952024-11-14T09:04:06.073ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41962024-11-14T09:04:06.074ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d13f12-7147-4394-b905-de73a698a206", "content-length": "1", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
41972024-11-14T09:04:06.074ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41982024-11-14T09:04:06.074ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 544.869823ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41992024-11-14T09:04:06.076ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42002024-11-14T09:04:06.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42012024-11-14T09:04:06.078ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 548.605714ms iteration = 13 status = null
42022024-11-14T09:04:06.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42032024-11-14T09:04:06.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42042024-11-14T09:04:06.117ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
42052024-11-14T09:04:06.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42062024-11-14T09:04:06.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42072024-11-14T09:04:06.120ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42082024-11-14T09:04:06.120ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a44e1f30-0719-4ffa-a622-a2726c7fdba5", "content-length": "691", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
42092024-11-14T09:04:06.120ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42102024-11-14T09:04:06.120ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42112024-11-14T09:04:06.120ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42122024-11-14T09:04:06.122ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 592.696612ms iteration = 13 status = {}
42132024-11-14T09:04:06.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42142024-11-14T09:04:06.128ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea371c41-c9f3-4a01-b7c3-36ae2224f721", "content-length": "134", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
42152024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42162024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
42172024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42182024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42192024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42202024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42212024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42222024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42232024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42242024-11-14T09:04:06.128ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42252024-11-14T09:04:06.129ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
42262024-11-14T09:04:06.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42272024-11-14T09:04:06.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42282024-11-14T09:04:06.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42292024-11-14T09:04:06.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "30077f44-34d7-4b34-b3dd-e968bc03d730", "content-length": "2", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
42302024-11-14T09:04:06.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42312024-11-14T09:04:06.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c05791fd-c0eb-41eb-aa77-2d494a2f8f27", "content-length": "52", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
42322024-11-14T09:04:06.131ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
42332024-11-14T09:04:06.131ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42342024-11-14T09:04:06.233ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "253542d1-d628-4b32-ad9a-d147ee20825b", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
42352024-11-14T09:04:06.233ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
42362024-11-14T09:04:06.233ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42372024-11-14T09:04:06.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c961b6b2-9c2b-4123-ac6a-3f87a5a254de", "content-length": "682", "date": "Thu, 14 Nov 2024 09:04:05 GMT"} })
42382024-11-14T09:04:06.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42392024-11-14T09:04:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42402024-11-14T09:04:06.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42412024-11-14T09:04:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42422024-11-14T09:04:06.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42432024-11-14T09:04:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42442024-11-14T09:04:06.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42452024-11-14T09:04:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42462024-11-14T09:04:06.253ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.865399ms iteration = 13 status = {}
42472024-11-14T09:04:06.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = d5058865-394a-418a-b9b7-8c400eb745fb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42482024-11-14T09:04:06.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = d5058865-394a-418a-b9b7-8c400eb745fb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42492024-11-14T09:04:06.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = d5058865-394a-418a-b9b7-8c400eb745fb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42502024-11-14T09:04:06.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7294e69d-8dd9-4ba9-a8b7-77c44ff06682 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42512024-11-14T09:04:06.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7294e69d-8dd9-4ba9-a8b7-77c44ff06682 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42522024-11-14T09:04:06.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7294e69d-8dd9-4ba9-a8b7-77c44ff06682 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42532024-11-14T09:04:07.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28398ce4-cc0a-4ea7-b403-683f1cb2f2a0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42542024-11-14T09:04:07.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28398ce4-cc0a-4ea7-b403-683f1cb2f2a0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42552024-11-14T09:04:07.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28398ce4-cc0a-4ea7-b403-683f1cb2f2a0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42562024-11-14T09:04:08.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc42e443-1682-4614-95cb-981693eea002 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42572024-11-14T09:04:08.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc42e443-1682-4614-95cb-981693eea002 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42582024-11-14T09:04:08.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc42e443-1682-4614-95cb-981693eea002 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42592024-11-14T09:04:09.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d34c5c26-d71f-499c-81f8-af56c570593d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42602024-11-14T09:04:09.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d34c5c26-d71f-499c-81f8-af56c570593d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42612024-11-14T09:04:09.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d34c5c26-d71f-499c-81f8-af56c570593d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42622024-11-14T09:04:10.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5b8dc440-a51e-4afb-8ae3-d6c6868a5374 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42632024-11-14T09:04:10.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5b8dc440-a51e-4afb-8ae3-d6c6868a5374 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42642024-11-14T09:04:10.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5b8dc440-a51e-4afb-8ae3-d6c6868a5374 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42652024-11-14T09:04:11.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95e75d15-e621-4b77-b112-7b34698c6be8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42662024-11-14T09:04:11.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95e75d15-e621-4b77-b112-7b34698c6be8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42672024-11-14T09:04:11.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 95e75d15-e621-4b77-b112-7b34698c6be8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42682024-11-14T09:04:12.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 38f692b5-2572-4ec7-b281-11724355706a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42692024-11-14T09:04:12.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 38f692b5-2572-4ec7-b281-11724355706a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42702024-11-14T09:04:12.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 38f692b5-2572-4ec7-b281-11724355706a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42712024-11-14T09:04:13.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7aeca78-520f-44bb-a5e8-9dd29664b314 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42722024-11-14T09:04:13.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7aeca78-520f-44bb-a5e8-9dd29664b314 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42732024-11-14T09:04:13.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7aeca78-520f-44bb-a5e8-9dd29664b314 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42742024-11-14T09:04:14.048ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1474 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = f37e84e1-7a92-4a8a-86b7-430f421cf494 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
42752024-11-14T09:04:14.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f56a151-de4f-4d69-86a3-c52a00907a79 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42762024-11-14T09:04:14.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f56a151-de4f-4d69-86a3-c52a00907a79 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42772024-11-14T09:04:14.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f56a151-de4f-4d69-86a3-c52a00907a79 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
42782024-11-14T09:04:15.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
42792024-11-14T09:04:15.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42802024-11-14T09:04:15.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
42812024-11-14T09:04:15.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42822024-11-14T09:04:15.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42832024-11-14T09:04:15.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42842024-11-14T09:04:15.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42852024-11-14T09:04:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42862024-11-14T09:04:15.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872024-11-14T09:04:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42882024-11-14T09:04:15.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42892024-11-14T09:04:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42902024-11-14T09:04:15.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42912024-11-14T09:04:15.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42922024-11-14T09:04:15.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42932024-11-14T09:04:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
42942024-11-14T09:04:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42952024-11-14T09:04:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42962024-11-14T09:04:15.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
42972024-11-14T09:04:15.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.239542ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
42982024-11-14T09:04:15.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.809059ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42992024-11-14T09:04:15.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ff44a5a2-dda2-4524-8e6c-32a562ce9c0c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43002024-11-14T09:04:15.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ff44a5a2-dda2-4524-8e6c-32a562ce9c0c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43012024-11-14T09:04:15.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ff44a5a2-dda2-4524-8e6c-32a562ce9c0c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43022024-11-14T09:04:16.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 907ecae6-4a2e-4184-b378-32abb85aedb6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43032024-11-14T09:04:16.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 907ecae6-4a2e-4184-b378-32abb85aedb6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43042024-11-14T09:04:16.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 907ecae6-4a2e-4184-b378-32abb85aedb6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43052024-11-14T09:04:17.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 248b0f4c-029e-4cb3-bd4c-1a2da0953c2d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43062024-11-14T09:04:17.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 248b0f4c-029e-4cb3-bd4c-1a2da0953c2d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43072024-11-14T09:04:17.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 248b0f4c-029e-4cb3-bd4c-1a2da0953c2d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43082024-11-14T09:04:18.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b076641d-2b7f-4682-9b76-fc2873720d2a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43092024-11-14T09:04:18.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b076641d-2b7f-4682-9b76-fc2873720d2a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43102024-11-14T09:04:18.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b076641d-2b7f-4682-9b76-fc2873720d2a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43112024-11-14T09:04:19.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f907b6f-527f-4864-b8a4-caed599c35d9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43122024-11-14T09:04:19.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f907b6f-527f-4864-b8a4-caed599c35d9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43132024-11-14T09:04:19.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f907b6f-527f-4864-b8a4-caed599c35d9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43142024-11-14T09:04:20.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = defd6580-bc3a-4da1-955f-83c1b53f78a3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43152024-11-14T09:04:20.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = defd6580-bc3a-4da1-955f-83c1b53f78a3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43162024-11-14T09:04:20.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = defd6580-bc3a-4da1-955f-83c1b53f78a3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43172024-11-14T09:04:21.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 52ee31a8-2c1e-480c-8f62-97d1bbbe46bd roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43182024-11-14T09:04:21.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 52ee31a8-2c1e-480c-8f62-97d1bbbe46bd resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43192024-11-14T09:04:21.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 52ee31a8-2c1e-480c-8f62-97d1bbbe46bd response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43202024-11-14T09:04:22.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a54a78d-187e-4cc9-bff2-e393184235cf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43212024-11-14T09:04:22.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a54a78d-187e-4cc9-bff2-e393184235cf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43222024-11-14T09:04:22.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8a54a78d-187e-4cc9-bff2-e393184235cf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43232024-11-14T09:04:23.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a09cc2e8-a906-43f9-8286-b49dc27fb0b4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43242024-11-14T09:04:23.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a09cc2e8-a906-43f9-8286-b49dc27fb0b4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43252024-11-14T09:04:23.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a09cc2e8-a906-43f9-8286-b49dc27fb0b4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43262024-11-14T09:04:24.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 91cabc11-0394-4d5b-b65d-ee47b9726ced roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43272024-11-14T09:04:24.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 91cabc11-0394-4d5b-b65d-ee47b9726ced resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43282024-11-14T09:04:24.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 91cabc11-0394-4d5b-b65d-ee47b9726ced response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43292024-11-14T09:04:25.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
43302024-11-14T09:04:25.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43312024-11-14T09:04:25.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
43322024-11-14T09:04:25.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43332024-11-14T09:04:25.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43342024-11-14T09:04:25.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43352024-11-14T09:04:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362024-11-14T09:04:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43372024-11-14T09:04:25.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43382024-11-14T09:04:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43392024-11-14T09:04:25.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43402024-11-14T09:04:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43412024-11-14T09:04:25.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43422024-11-14T09:04:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
43432024-11-14T09:04:25.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43442024-11-14T09:04:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43452024-11-14T09:04:25.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
43462024-11-14T09:04:25.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.506452ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
43472024-11-14T09:04:25.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43482024-11-14T09:04:25.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43492024-11-14T09:04:25.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.532047ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43502024-11-14T09:04:25.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d696e3f-8f19-4d5b-be9c-28c7be3f7b2c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43512024-11-14T09:04:25.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d696e3f-8f19-4d5b-be9c-28c7be3f7b2c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43522024-11-14T09:04:25.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d696e3f-8f19-4d5b-be9c-28c7be3f7b2c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43532024-11-14T09:04:26.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 19f98d19-5634-427b-97b6-52261aeefb32 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43542024-11-14T09:04:26.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 19f98d19-5634-427b-97b6-52261aeefb32 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43552024-11-14T09:04:26.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 19f98d19-5634-427b-97b6-52261aeefb32 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43562024-11-14T09:04:27.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63ed8aa4-2039-4268-b37d-38f2a5a52067 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43572024-11-14T09:04:27.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63ed8aa4-2039-4268-b37d-38f2a5a52067 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43582024-11-14T09:04:27.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63ed8aa4-2039-4268-b37d-38f2a5a52067 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43592024-11-14T09:04:28.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09385cd0-bc0f-410c-a2a5-e94bec2dee85 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43602024-11-14T09:04:28.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09385cd0-bc0f-410c-a2a5-e94bec2dee85 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43612024-11-14T09:04:29.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09385cd0-bc0f-410c-a2a5-e94bec2dee85 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43622024-11-14T09:04:29.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 5f3cb475-6515-45a0-b2a1-d8f7a4b74b00 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
43632024-11-14T09:04:30.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f199226-9e3f-47ae-bb96-9ecdca654b5e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43642024-11-14T09:04:30.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f199226-9e3f-47ae-bb96-9ecdca654b5e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43652024-11-14T09:04:30.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f199226-9e3f-47ae-bb96-9ecdca654b5e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43662024-11-14T09:04:31.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97829da8-0e4f-400f-8243-f851ca918030 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43672024-11-14T09:04:31.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97829da8-0e4f-400f-8243-f851ca918030 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43682024-11-14T09:04:31.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97829da8-0e4f-400f-8243-f851ca918030 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43692024-11-14T09:04:32.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c45e40f7-2117-46ec-9a6c-db5fbfbeae53 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43702024-11-14T09:04:32.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c45e40f7-2117-46ec-9a6c-db5fbfbeae53 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43712024-11-14T09:04:32.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c45e40f7-2117-46ec-9a6c-db5fbfbeae53 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43722024-11-14T09:04:33.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef588d0e-bbe5-40f0-aa15-80cbef47a397 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43732024-11-14T09:04:33.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef588d0e-bbe5-40f0-aa15-80cbef47a397 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43742024-11-14T09:04:33.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef588d0e-bbe5-40f0-aa15-80cbef47a397 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43752024-11-14T09:04:34.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 8531b210-8d81-4b1f-8caf-4d65a1cf803f roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
43762024-11-14T09:04:34.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 8531b210-8d81-4b1f-8caf-4d65a1cf803f resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
43772024-11-14T09:04:34.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 8531b210-8d81-4b1f-8caf-4d65a1cf803f response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
43782024-11-14T09:04:34.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 1afb127b-bfdb-4a69-abad-e4ac697f7524 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
43792024-11-14T09:04:34.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 1afb127b-bfdb-4a69-abad-e4ac697f7524 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
43802024-11-14T09:04:34.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44081 req_id = 1afb127b-bfdb-4a69-abad-e4ac697f7524 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
43812024-11-14T09:04:34.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba47e682-4ca3-4849-856d-927b8be99bb7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43822024-11-14T09:04:34.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba47e682-4ca3-4849-856d-927b8be99bb7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43832024-11-14T09:04:34.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba47e682-4ca3-4849-856d-927b8be99bb7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43842024-11-14T09:04:35.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 730e83d9-9828-403a-b6c1-f1631e17bd76 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43852024-11-14T09:04:35.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 730e83d9-9828-403a-b6c1-f1631e17bd76 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43862024-11-14T09:04:35.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 730e83d9-9828-403a-b6c1-f1631e17bd76 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
43872024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
43882024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43892024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
43902024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
43912024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
43922024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43932024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
43942024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
43952024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43962024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43972024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
43982024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43992024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44002024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
44012024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
44022024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44032024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
44042024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44052024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44062024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
44072024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44082024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44092024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
44102024-11-14T09:04:35.530ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44112024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
44122024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44132024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44142024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44152024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44162024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44172024-11-14T09:04:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44182024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44192024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44202024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44212024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44222024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44232024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44242024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44252024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44262024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
44272024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44282024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
44292024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
44302024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44312024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44322024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
44332024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44342024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44352024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44362024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44372024-11-14T09:04:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44382024-11-14T09:04:35.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44392024-11-14T09:04:35.534ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.586084ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44402024-11-14T09:04:35.535ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44412024-11-14T09:04:35.535ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44422024-11-14T09:04:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44432024-11-14T09:04:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44442024-11-14T09:04:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44452024-11-14T09:04:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44462024-11-14T09:04:35.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44472024-11-14T09:04:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44482024-11-14T09:04:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44492024-11-14T09:04:35.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44502024-11-14T09:04:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44512024-11-14T09:04:35.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44522024-11-14T09:04:35.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-11-14T09:04:35.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 328197165 } })
44542024-11-14T09:04:35.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
44552024-11-14T09:04:35.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 329140280 } })
44562024-11-14T09:04:35.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44572024-11-14T09:04:35.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
44582024-11-14T09:04:35.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44592024-11-14T09:04:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44602024-11-14T09:04:35.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44612024-11-14T09:04:35.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44622024-11-14T09:04:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44632024-11-14T09:04:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44642024-11-14T09:04:35.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44652024-11-14T09:04:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44662024-11-14T09:04:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44672024-11-14T09:04:35.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44682024-11-14T09:04:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44692024-11-14T09:04:35.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44702024-11-14T09:04:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44712024-11-14T09:04:35.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44722024-11-14T09:04:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44732024-11-14T09:04:35.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44742024-11-14T09:04:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44752024-11-14T09:04:35.550ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44762024-11-14T09:04:35.550ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44772024-11-14T09:04:35.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44782024-11-14T09:04:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44792024-11-14T09:04:35.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.660288ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44802024-11-14T09:04:35.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44812024-11-14T09:04:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44822024-11-14T09:04:35.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44832024-11-14T09:04:35.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44842024-11-14T09:04:35.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44852024-11-14T09:04:35.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44862024-11-14T09:04:35.561ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44872024-11-14T09:04:35.561ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44882024-11-14T09:04:35.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 30.856825ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44892024-11-14T09:04:35.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44902024-11-14T09:04:35.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44912024-11-14T09:04:35.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 350295530 } })
44922024-11-14T09:04:35.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-11-14T09:04:35.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
44942024-11-14T09:04:35.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44952024-11-14T09:04:35.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44962024-11-14T09:04:35.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44972024-11-14T09:04:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
44982024-11-14T09:04:35.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44992024-11-14T09:04:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45002024-11-14T09:04:35.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45012024-11-14T09:04:35.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45022024-11-14T09:04:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45032024-11-14T09:04:35.579ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 49.334153ms iteration = 17 status = {"physical_disks_added":0}
45042024-11-14T09:04:35.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
45052024-11-14T09:04:35.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.085037ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
45062024-11-14T09:04:35.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45072024-11-14T09:04:35.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45082024-11-14T09:04:35.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.860757ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45092024-11-14T09:04:35.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45102024-11-14T09:04:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45112024-11-14T09:04:35.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45122024-11-14T09:04:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45132024-11-14T09:04:35.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45142024-11-14T09:04:35.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.38134ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
45152024-11-14T09:04:35.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45162024-11-14T09:04:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45172024-11-14T09:04:35.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.179398ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
45182024-11-14T09:04:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
45192024-11-14T09:04:35.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45202024-11-14T09:04:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45212024-11-14T09:04:35.604ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45222024-11-14T09:04:35.604ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.0866ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45232024-11-14T09:04:35.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45242024-11-14T09:04:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45252024-11-14T09:04:35.605ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.547524ms iteration = 14 status = 0
45262024-11-14T09:04:35.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.353411ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45272024-11-14T09:04:35.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45282024-11-14T09:04:35.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45292024-11-14T09:04:35.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45302024-11-14T09:04:35.622ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45312024-11-14T09:04:35.622ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9f630a6-6bd9-409a-8bda-ac90958c8182", "content-length": "26", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45322024-11-14T09:04:35.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45332024-11-14T09:04:35.625ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45342024-11-14T09:04:35.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45352024-11-14T09:04:35.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45362024-11-14T09:04:35.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
45372024-11-14T09:04:35.641ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45382024-11-14T09:04:35.641ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88bb0144-ece0-4a06-ae6d-3897c90d21b6", "content-length": "26", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45392024-11-14T09:04:35.641ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45402024-11-14T09:04:35.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45412024-11-14T09:04:35.641ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45422024-11-14T09:04:35.642ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "494c7be4-3ffc-4951-9f6f-e5954fd6d6e0", "content-length": "26", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45432024-11-14T09:04:35.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45442024-11-14T09:04:35.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45452024-11-14T09:04:35.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
45462024-11-14T09:04:35.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45472024-11-14T09:04:35.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45482024-11-14T09:04:35.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45492024-11-14T09:04:35.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45502024-11-14T09:04:35.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.711463ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45512024-11-14T09:04:35.738ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.723288ms iteration = 14 status = {}
45522024-11-14T09:04:35.775ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45532024-11-14T09:04:35.776ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b930b0-dc52-4945-9a00-bbdbece964f4", "content-length": "1", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45542024-11-14T09:04:35.778ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45552024-11-14T09:04:35.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45562024-11-14T09:04:35.823ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45572024-11-14T09:04:35.823ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45582024-11-14T09:04:35.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e1df1b-83cf-4a12-b81f-7a27cc5431c0", "content-length": "372", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45592024-11-14T09:04:35.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45602024-11-14T09:04:35.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45612024-11-14T09:04:35.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45622024-11-14T09:04:35.827ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 296.852099ms iteration = 14 status = null
45632024-11-14T09:04:35.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45642024-11-14T09:04:35.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45652024-11-14T09:04:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45662024-11-14T09:04:35.877ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45672024-11-14T09:04:35.877ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45682024-11-14T09:04:35.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cd77204c-a95f-43f4-965e-0ed33b8badf5", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45692024-11-14T09:04:35.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45702024-11-14T09:04:35.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45712024-11-14T09:04:35.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45722024-11-14T09:04:35.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45732024-11-14T09:04:35.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45742024-11-14T09:04:35.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45752024-11-14T09:04:35.887ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45762024-11-14T09:04:35.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45772024-11-14T09:04:35.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c5ddbfa1-b986-428e-ba12-924bbcf2914e", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45782024-11-14T09:04:35.889ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.655402ms iteration = 15 status = {}
45792024-11-14T09:04:35.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45802024-11-14T09:04:35.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffdc1a16-2358-45e5-a950-2c5275459ae2", "content-length": "691", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45812024-11-14T09:04:35.894ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45822024-11-14T09:04:35.894ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45832024-11-14T09:04:35.894ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45842024-11-14T09:04:35.896ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 365.873179ms iteration = 14 status = {}
45852024-11-14T09:04:35.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45862024-11-14T09:04:35.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45872024-11-14T09:04:35.922ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
45882024-11-14T09:04:35.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45892024-11-14T09:04:35.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45902024-11-14T09:04:35.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45912024-11-14T09:04:35.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b839f153-f427-4a60-8e2f-f51d0cd88da6", "content-length": "134", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
45922024-11-14T09:04:35.931ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45932024-11-14T09:04:35.931ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
45942024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45952024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45962024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45972024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45982024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45992024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46002024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46012024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46022024-11-14T09:04:35.932ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
46032024-11-14T09:04:35.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46042024-11-14T09:04:35.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46052024-11-14T09:04:35.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46062024-11-14T09:04:35.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd322a85-f3f0-44e7-b8ba-9c5ac85b85b1", "content-length": "2", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
46072024-11-14T09:04:35.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46082024-11-14T09:04:35.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b019758-19da-47f9-ae9c-02adad0dd279", "content-length": "52", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
46092024-11-14T09:04:35.934ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
46102024-11-14T09:04:35.934ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46112024-11-14T09:04:36.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0272c96d-29d2-4a18-9134-cc31ed8979d7", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
46122024-11-14T09:04:36.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
46132024-11-14T09:04:36.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46142024-11-14T09:04:36.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f734e6af-ec0f-4f95-86ca-74e1f0199afb", "content-length": "682", "date": "Thu, 14 Nov 2024 09:04:35 GMT"} })
46152024-11-14T09:04:36.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46162024-11-14T09:04:36.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46172024-11-14T09:04:36.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46182024-11-14T09:04:36.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46192024-11-14T09:04:36.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46202024-11-14T09:04:36.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46212024-11-14T09:04:36.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46222024-11-14T09:04:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46232024-11-14T09:04:36.053ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 523.131354ms iteration = 14 status = {}
46242024-11-14T09:04:36.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a88a4096-b165-4973-a70c-b9ef43a7b7e4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46252024-11-14T09:04:36.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a88a4096-b165-4973-a70c-b9ef43a7b7e4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46262024-11-14T09:04:36.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a88a4096-b165-4973-a70c-b9ef43a7b7e4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46272024-11-14T09:04:36.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = ec51ed58-ebe1-45c8-872d-d2d3394e84d6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46282024-11-14T09:04:36.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = ec51ed58-ebe1-45c8-872d-d2d3394e84d6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46292024-11-14T09:04:36.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = ec51ed58-ebe1-45c8-872d-d2d3394e84d6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46302024-11-14T09:04:37.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bdab035a-24a2-452c-8801-1374955b7a3d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46312024-11-14T09:04:37.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bdab035a-24a2-452c-8801-1374955b7a3d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46322024-11-14T09:04:37.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bdab035a-24a2-452c-8801-1374955b7a3d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46332024-11-14T09:04:38.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c81f9408-8884-4642-9b4f-7d06138bc7b6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46342024-11-14T09:04:38.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c81f9408-8884-4642-9b4f-7d06138bc7b6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46352024-11-14T09:04:38.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c81f9408-8884-4642-9b4f-7d06138bc7b6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46362024-11-14T09:04:39.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd142514-1fd9-4214-ad8e-fd1216bb519a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46372024-11-14T09:04:39.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd142514-1fd9-4214-ad8e-fd1216bb519a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46382024-11-14T09:04:39.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd142514-1fd9-4214-ad8e-fd1216bb519a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46392024-11-14T09:04:40.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9eb5ad07-2a7d-4ecd-8f20-17bac595c383 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46402024-11-14T09:04:40.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9eb5ad07-2a7d-4ecd-8f20-17bac595c383 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46412024-11-14T09:04:40.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9eb5ad07-2a7d-4ecd-8f20-17bac595c383 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46422024-11-14T09:04:41.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8504b093-74e4-4f26-a0c7-0c32afa2547b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46432024-11-14T09:04:41.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8504b093-74e4-4f26-a0c7-0c32afa2547b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46442024-11-14T09:04:41.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8504b093-74e4-4f26-a0c7-0c32afa2547b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46452024-11-14T09:04:42.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 34251a60-ee36-4862-8027-8b638460c540 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46462024-11-14T09:04:42.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 34251a60-ee36-4862-8027-8b638460c540 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46472024-11-14T09:04:42.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 34251a60-ee36-4862-8027-8b638460c540 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46482024-11-14T09:04:43.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48656f69-5619-4303-bcc5-040fc07051a8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46492024-11-14T09:04:43.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48656f69-5619-4303-bcc5-040fc07051a8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46502024-11-14T09:04:43.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48656f69-5619-4303-bcc5-040fc07051a8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46512024-11-14T09:04:44.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1447 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = e30bff96-1e4a-4e34-b235-ac2e355169d3 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
46522024-11-14T09:04:44.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12dbd5ee-42ab-4373-b8b7-6787e621069a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46532024-11-14T09:04:44.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12dbd5ee-42ab-4373-b8b7-6787e621069a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46542024-11-14T09:04:44.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12dbd5ee-42ab-4373-b8b7-6787e621069a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46552024-11-14T09:04:45.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 24648545-d65f-4eea-b6a2-053a8417c82d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46562024-11-14T09:04:45.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 24648545-d65f-4eea-b6a2-053a8417c82d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46572024-11-14T09:04:45.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 24648545-d65f-4eea-b6a2-053a8417c82d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46582024-11-14T09:04:45.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
46592024-11-14T09:04:45.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46602024-11-14T09:04:45.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
46612024-11-14T09:04:45.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46622024-11-14T09:04:45.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46632024-11-14T09:04:45.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46642024-11-14T09:04:45.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46652024-11-14T09:04:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46662024-11-14T09:04:45.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672024-11-14T09:04:45.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.133257ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46682024-11-14T09:04:45.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46692024-11-14T09:04:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46702024-11-14T09:04:45.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46712024-11-14T09:04:45.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46722024-11-14T09:04:45.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46732024-11-14T09:04:45.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46742024-11-14T09:04:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
46752024-11-14T09:04:45.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46762024-11-14T09:04:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46772024-11-14T09:04:45.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
46782024-11-14T09:04:45.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.68911ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
46792024-11-14T09:04:46.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3ac22b4a-7a7d-4121-b294-4f9fa80ab6f1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46802024-11-14T09:04:46.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3ac22b4a-7a7d-4121-b294-4f9fa80ab6f1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46812024-11-14T09:04:46.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3ac22b4a-7a7d-4121-b294-4f9fa80ab6f1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46822024-11-14T09:04:47.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 20346ce2-f952-4c4f-8d86-ba22bd5ef656 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46832024-11-14T09:04:47.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 20346ce2-f952-4c4f-8d86-ba22bd5ef656 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46842024-11-14T09:04:47.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 20346ce2-f952-4c4f-8d86-ba22bd5ef656 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46852024-11-14T09:04:48.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62f2f05b-62e6-4742-ba33-a1995c44b550 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46862024-11-14T09:04:48.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62f2f05b-62e6-4742-ba33-a1995c44b550 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46872024-11-14T09:04:48.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62f2f05b-62e6-4742-ba33-a1995c44b550 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46882024-11-14T09:04:49.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b6c260ac-cda6-4565-88c3-6f833f96b9fa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46892024-11-14T09:04:49.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b6c260ac-cda6-4565-88c3-6f833f96b9fa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46902024-11-14T09:04:49.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b6c260ac-cda6-4565-88c3-6f833f96b9fa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46912024-11-14T09:04:50.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98ac0225-9f37-408c-99ee-77574fb43001 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46922024-11-14T09:04:50.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98ac0225-9f37-408c-99ee-77574fb43001 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46932024-11-14T09:04:50.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98ac0225-9f37-408c-99ee-77574fb43001 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46942024-11-14T09:04:51.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a021bb6a-78fe-41ed-a5ae-483dcaee4630 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46952024-11-14T09:04:51.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a021bb6a-78fe-41ed-a5ae-483dcaee4630 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46962024-11-14T09:04:51.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a021bb6a-78fe-41ed-a5ae-483dcaee4630 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46972024-11-14T09:04:52.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ff838486-f2f8-4368-b789-80c2a01c21c4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46982024-11-14T09:04:52.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ff838486-f2f8-4368-b789-80c2a01c21c4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
46992024-11-14T09:04:52.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ff838486-f2f8-4368-b789-80c2a01c21c4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47002024-11-14T09:04:53.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 30711c45-1bcb-4504-b269-17df1c26b729 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47012024-11-14T09:04:53.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 30711c45-1bcb-4504-b269-17df1c26b729 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47022024-11-14T09:04:53.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 30711c45-1bcb-4504-b269-17df1c26b729 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47032024-11-14T09:04:54.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 43f833d6-df8a-443e-ba3c-c20ad9156841 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47042024-11-14T09:04:54.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 43f833d6-df8a-443e-ba3c-c20ad9156841 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47052024-11-14T09:04:54.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 43f833d6-df8a-443e-ba3c-c20ad9156841 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47062024-11-14T09:04:55.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
47072024-11-14T09:04:55.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47082024-11-14T09:04:55.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
47092024-11-14T09:04:55.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47102024-11-14T09:04:55.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47112024-11-14T09:04:55.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47122024-11-14T09:04:55.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47132024-11-14T09:04:55.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47142024-11-14T09:04:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47152024-11-14T09:04:55.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.32683ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47162024-11-14T09:04:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47172024-11-14T09:04:55.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47182024-11-14T09:04:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47192024-11-14T09:04:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47202024-11-14T09:04:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47212024-11-14T09:04:55.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222024-11-14T09:04:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
47232024-11-14T09:04:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47242024-11-14T09:04:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47252024-11-14T09:04:55.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
47262024-11-14T09:04:55.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.757857ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
47272024-11-14T09:04:55.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8d10600d-1821-4beb-aead-e8016a8a672c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47282024-11-14T09:04:55.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8d10600d-1821-4beb-aead-e8016a8a672c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47292024-11-14T09:04:55.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8d10600d-1821-4beb-aead-e8016a8a672c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47302024-11-14T09:04:56.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ade72fc5-a9e2-4b7a-9436-5cd311a73fdb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47312024-11-14T09:04:56.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ade72fc5-a9e2-4b7a-9436-5cd311a73fdb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47322024-11-14T09:04:56.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ade72fc5-a9e2-4b7a-9436-5cd311a73fdb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47332024-11-14T09:04:57.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a439efbc-4303-48f3-83db-19c49f9f04bb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47342024-11-14T09:04:57.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a439efbc-4303-48f3-83db-19c49f9f04bb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47352024-11-14T09:04:57.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a439efbc-4303-48f3-83db-19c49f9f04bb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47362024-11-14T09:04:58.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b48ad3c-62c3-4447-a6b2-733b878870d7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47372024-11-14T09:04:58.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b48ad3c-62c3-4447-a6b2-733b878870d7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47382024-11-14T09:04:58.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b48ad3c-62c3-4447-a6b2-733b878870d7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47392024-11-14T09:04:59.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 2663bbe3-988a-4d1a-9f06-fa691a04ace5 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
47402024-11-14T09:04:59.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d576dc85-b933-4f72-9d7c-2d456a7df3aa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47412024-11-14T09:04:59.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d576dc85-b933-4f72-9d7c-2d456a7df3aa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47422024-11-14T09:04:59.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d576dc85-b933-4f72-9d7c-2d456a7df3aa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47432024-11-14T09:05:00.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7545cb2d-f289-4bc9-9c7e-bc503761bd48 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47442024-11-14T09:05:00.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7545cb2d-f289-4bc9-9c7e-bc503761bd48 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47452024-11-14T09:05:00.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7545cb2d-f289-4bc9-9c7e-bc503761bd48 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47462024-11-14T09:05:01.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 67eab6c3-225c-4879-bdde-ded933897f9b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47472024-11-14T09:05:01.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 67eab6c3-225c-4879-bdde-ded933897f9b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47482024-11-14T09:05:01.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 67eab6c3-225c-4879-bdde-ded933897f9b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47492024-11-14T09:05:02.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bc71736-0ab3-4cb3-8181-15822c8677a5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47502024-11-14T09:05:02.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bc71736-0ab3-4cb3-8181-15822c8677a5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47512024-11-14T09:05:02.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bc71736-0ab3-4cb3-8181-15822c8677a5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47522024-11-14T09:05:03.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c369cb8f-b37c-4ca8-af2d-a122a54db3be roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47532024-11-14T09:05:03.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c369cb8f-b37c-4ca8-af2d-a122a54db3be resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47542024-11-14T09:05:03.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c369cb8f-b37c-4ca8-af2d-a122a54db3be response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47552024-11-14T09:05:04.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a7e46af3-dc7f-4804-8bc9-b2b9072bd20b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47562024-11-14T09:05:04.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a7e46af3-dc7f-4804-8bc9-b2b9072bd20b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47572024-11-14T09:05:04.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a7e46af3-dc7f-4804-8bc9-b2b9072bd20b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
47582024-11-14T09:05:05.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
47592024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47602024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
47612024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
47622024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
47632024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
47642024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
47652024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47662024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47672024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47682024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
47692024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
47702024-11-14T09:05:05.531ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47712024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
47722024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47732024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47742024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
47752024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47762024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47772024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47782024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
47792024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
47802024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
47812024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47822024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47832024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47842024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
47852024-11-14T09:05:05.531ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
47862024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.24\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
47872024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
47882024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
47892024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47902024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
47912024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
47922024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
47932024-11-14T09:05:05.531ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:55:05.531204005 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47942024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47952024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
47962024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47972024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47982024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
47992024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48002024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48012024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
48022024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48032024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
48042024-11-14T09:05:05.531ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48052024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48062024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
48072024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48082024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
48092024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48102024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
48112024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48122024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
48132024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48142024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
48152024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48162024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
48172024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48182024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
48192024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48202024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48212024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48222024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48232024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48242024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48252024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48262024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48272024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48282024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48292024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48302024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48312024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48322024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48332024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48342024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48352024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48362024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48372024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48382024-11-14T09:05:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48392024-11-14T09:05:05.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 319417134 } })
48402024-11-14T09:05:05.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 319424664 } })
48412024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48422024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48432024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48442024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48452024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48462024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48472024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.447133ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48482024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
48492024-11-14T09:05:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.27719ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
48502024-11-14T09:05:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48512024-11-14T09:05:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48522024-11-14T09:05:05.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48532024-11-14T09:05:05.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48542024-11-14T09:05:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48552024-11-14T09:05:05.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48562024-11-14T09:05:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.785477ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48572024-11-14T09:05:05.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48582024-11-14T09:05:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48592024-11-14T09:05:05.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48602024-11-14T09:05:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48612024-11-14T09:05:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48622024-11-14T09:05:05.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48632024-11-14T09:05:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48642024-11-14T09:05:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48652024-11-14T09:05:05.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48662024-11-14T09:05:05.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48672024-11-14T09:05:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48682024-11-14T09:05:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48692024-11-14T09:05:05.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48702024-11-14T09:05:05.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-11-14T09:05:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48722024-11-14T09:05:05.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48732024-11-14T09:05:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48742024-11-14T09:05:05.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48752024-11-14T09:05:05.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48762024-11-14T09:05:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48772024-11-14T09:05:05.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 335151357 } })
48782024-11-14T09:05:05.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48792024-11-14T09:05:05.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
48802024-11-14T09:05:05.549ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:55:05.531204005 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48812024-11-14T09:05:05.549ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.802846ms iteration = 8 status = {"expiration":"2024-11-14T08:55:05.531204005Z","pruned":[]}
48822024-11-14T09:05:05.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48832024-11-14T09:05:05.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48842024-11-14T09:05:05.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48852024-11-14T09:05:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48862024-11-14T09:05:05.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48872024-11-14T09:05:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48882024-11-14T09:05:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48892024-11-14T09:05:05.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48902024-11-14T09:05:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48912024-11-14T09:05:05.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 341051701 } })
48922024-11-14T09:05:05.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
48932024-11-14T09:05:05.554ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.651353ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
48942024-11-14T09:05:05.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48952024-11-14T09:05:05.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48962024-11-14T09:05:05.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 345361741 } })
48972024-11-14T09:05:05.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
48982024-11-14T09:05:05.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48992024-11-14T09:05:05.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49002024-11-14T09:05:05.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49012024-11-14T09:05:05.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49022024-11-14T09:05:05.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49032024-11-14T09:05:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49042024-11-14T09:05:05.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49052024-11-14T09:05:05.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49062024-11-14T09:05:05.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49072024-11-14T09:05:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49082024-11-14T09:05:05.572ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49092024-11-14T09:05:05.572ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49102024-11-14T09:05:05.572ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49112024-11-14T09:05:05.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49122024-11-14T09:05:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49132024-11-14T09:05:05.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49142024-11-14T09:05:05.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.027071ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49152024-11-14T09:05:05.579ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49162024-11-14T09:05:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
49172024-11-14T09:05:05.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49182024-11-14T09:05:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49192024-11-14T09:05:05.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49202024-11-14T09:05:05.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49212024-11-14T09:05:05.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49222024-11-14T09:05:05.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49232024-11-14T09:05:05.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49242024-11-14T09:05:05.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49252024-11-14T09:05:05.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49262024-11-14T09:05:05.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49272024-11-14T09:05:05.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49282024-11-14T09:05:05.592ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49292024-11-14T09:05:05.592ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49302024-11-14T09:05:05.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49312024-11-14T09:05:05.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49322024-11-14T09:05:05.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332024-11-14T09:05:05.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-11-14T09:05:05.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49352024-11-14T09:05:05.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49362024-11-14T09:05:05.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372024-11-14T09:05:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49382024-11-14T09:05:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49392024-11-14T09:05:05.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49402024-11-14T09:05:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49412024-11-14T09:05:05.600ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
49422024-11-14T09:05:05.600ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
49432024-11-14T09:05:05.600ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.418106ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
49442024-11-14T09:05:05.601ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49452024-11-14T09:05:05.601ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49462024-11-14T09:05:05.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49472024-11-14T09:05:05.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49482024-11-14T09:05:05.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.690686ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
49492024-11-14T09:05:05.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49502024-11-14T09:05:05.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49512024-11-14T09:05:05.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49522024-11-14T09:05:05.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49532024-11-14T09:05:05.607ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
49542024-11-14T09:05:05.607ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
49552024-11-14T09:05:05.607ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
49562024-11-14T09:05:05.607ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 76.628601ms iteration = 9 status = {"generation":1}
49572024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49582024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49592024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
49602024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.115099ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
49612024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49622024-11-14T09:05:05.608ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49632024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49642024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49652024-11-14T09:05:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49662024-11-14T09:05:05.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49672024-11-14T09:05:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49682024-11-14T09:05:05.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.011065ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
49692024-11-14T09:05:05.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 81.258466ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49702024-11-14T09:05:05.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.554677ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49712024-11-14T09:05:05.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49722024-11-14T09:05:05.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49732024-11-14T09:05:05.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.439065ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49742024-11-14T09:05:05.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752024-11-14T09:05:05.624ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49762024-11-14T09:05:05.624ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49772024-11-14T09:05:05.624ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.541123ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49782024-11-14T09:05:05.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49792024-11-14T09:05:05.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49802024-11-14T09:05:05.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.488354ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49812024-11-14T09:05:05.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822024-11-14T09:05:05.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49832024-11-14T09:05:05.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49842024-11-14T09:05:05.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49852024-11-14T09:05:05.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49862024-11-14T09:05:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49872024-11-14T09:05:05.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49882024-11-14T09:05:05.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49892024-11-14T09:05:05.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902024-11-14T09:05:05.644ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49912024-11-14T09:05:05.644ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49922024-11-14T09:05:05.644ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.684426ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49932024-11-14T09:05:05.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49942024-11-14T09:05:05.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49952024-11-14T09:05:05.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
49962024-11-14T09:05:05.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49972024-11-14T09:05:05.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49982024-11-14T09:05:05.648ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49992024-11-14T09:05:05.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50002024-11-14T09:05:05.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50012024-11-14T09:05:05.650ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.436919ms iteration = 15 status = 0
50022024-11-14T09:05:05.655ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
50032024-11-14T09:05:05.655ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 124.240316ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
50042024-11-14T09:05:05.669ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50052024-11-14T09:05:05.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50062024-11-14T09:05:05.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50072024-11-14T09:05:05.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50082024-11-14T09:05:05.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50092024-11-14T09:05:05.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50102024-11-14T09:05:05.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
50112024-11-14T09:05:05.683ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50122024-11-14T09:05:05.683ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85ef7700-7c58-48b4-94e1-4009d4ae089a", "content-length": "26", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50132024-11-14T09:05:05.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50142024-11-14T09:05:05.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50152024-11-14T09:05:05.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50162024-11-14T09:05:05.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50172024-11-14T09:05:05.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50182024-11-14T09:05:05.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50192024-11-14T09:05:05.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
50202024-11-14T09:05:05.718ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50212024-11-14T09:05:05.718ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6c092e-0cb3-4bd0-b7bc-303fc14a4696", "content-length": "26", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50222024-11-14T09:05:05.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50232024-11-14T09:05:05.719ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
50242024-11-14T09:05:05.719ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
50252024-11-14T09:05:05.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50262024-11-14T09:05:05.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50272024-11-14T09:05:05.720ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
50282024-11-14T09:05:05.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 189.449124ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
50292024-11-14T09:05:05.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50302024-11-14T09:05:05.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
50312024-11-14T09:05:05.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50322024-11-14T09:05:05.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50332024-11-14T09:05:05.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50342024-11-14T09:05:05.726ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
50352024-11-14T09:05:05.726ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50362024-11-14T09:05:05.726ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
50372024-11-14T09:05:05.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 195.349968ms iteration = 9 status = {"generation":2}
50382024-11-14T09:05:05.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50392024-11-14T09:05:05.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50402024-11-14T09:05:05.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
50412024-11-14T09:05:05.756ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50422024-11-14T09:05:05.756ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f327c77e-b3fc-4ff2-a1f5-1b29ea7468c1", "content-length": "26", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50432024-11-14T09:05:05.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50442024-11-14T09:05:05.760ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50452024-11-14T09:05:05.769ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 238.414621ms iteration = 18 status = {"physical_disks_added":0}
50462024-11-14T09:05:05.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50472024-11-14T09:05:05.808ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b79a9f44-b277-493a-8175-b9843c361070", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50482024-11-14T09:05:05.808ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50492024-11-14T09:05:05.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4af07eb1-4d31-4852-a34d-722c0369a300", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50502024-11-14T09:05:05.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50512024-11-14T09:05:05.811ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50522024-11-14T09:05:05.811ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 280.600078ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50532024-11-14T09:05:05.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 272493c5-2a3a-48e1-ad92-0ddaeabccaff roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
50542024-11-14T09:05:05.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 272493c5-2a3a-48e1-ad92-0ddaeabccaff resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
50552024-11-14T09:05:05.836ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50562024-11-14T09:05:05.839ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50572024-11-14T09:05:05.839ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3beec9a5-c5f6-417b-a43f-187ec7587b75", "content-length": "1", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50582024-11-14T09:05:05.841ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50592024-11-14T09:05:05.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50602024-11-14T09:05:05.855ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50612024-11-14T09:05:05.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50622024-11-14T09:05:05.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50632024-11-14T09:05:05.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 272493c5-2a3a-48e1-ad92-0ddaeabccaff response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
50642024-11-14T09:05:05.858ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 327.502222ms iteration = 15 status = null
50652024-11-14T09:05:05.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50662024-11-14T09:05:05.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50672024-11-14T09:05:05.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50682024-11-14T09:05:05.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50692024-11-14T09:05:05.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50702024-11-14T09:05:05.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50712024-11-14T09:05:05.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50722024-11-14T09:05:05.883ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 352.400392ms iteration = 15 status = {}
50732024-11-14T09:05:05.903ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50742024-11-14T09:05:05.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "78b9778e-efe9-4988-88e8-e6071f120057", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50752024-11-14T09:05:05.904ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50762024-11-14T09:05:05.906ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b2440b06-dbee-4765-b8f9-8e72e59eab90", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50772024-11-14T09:05:05.906ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50782024-11-14T09:05:05.907ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "884b25b4-eb52-4aaa-a340-5f5962bd230c", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50792024-11-14T09:05:05.907ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50802024-11-14T09:05:05.908ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50812024-11-14T09:05:05.908ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 377.548145ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50822024-11-14T09:05:05.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50832024-11-14T09:05:05.938ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "878d654d-4cd2-48a1-8ebb-a5a861343a8b", "content-length": "691", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50842024-11-14T09:05:05.938ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50852024-11-14T09:05:05.938ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50862024-11-14T09:05:05.938ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50872024-11-14T09:05:05.939ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "09d0f15e-02d3-4771-a80d-93a46a95d31c", "content-length": "372", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50882024-11-14T09:05:05.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50892024-11-14T09:05:05.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50902024-11-14T09:05:05.940ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 409.187415ms iteration = 15 status = {}
50912024-11-14T09:05:05.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50922024-11-14T09:05:05.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50932024-11-14T09:05:05.945ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
50942024-11-14T09:05:05.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50952024-11-14T09:05:05.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50962024-11-14T09:05:05.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50972024-11-14T09:05:05.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "29df5760-1021-4cce-9ac6-e78ef0f6aebc", "content-length": "134", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
50982024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50992024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
51002024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51012024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51022024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51032024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51042024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51052024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51062024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51072024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51082024-11-14T09:05:05.956ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
51092024-11-14T09:05:05.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51102024-11-14T09:05:05.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51112024-11-14T09:05:05.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51122024-11-14T09:05:05.959ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "10ee5b4f-aab0-4752-8579-70907c33ef2b", "content-length": "2", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
51132024-11-14T09:05:05.959ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51142024-11-14T09:05:05.959ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dac6be5-d6cf-4e6a-8fbc-479673e3163e", "content-length": "52", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
51152024-11-14T09:05:05.959ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
51162024-11-14T09:05:05.959ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51172024-11-14T09:05:05.982ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51182024-11-14T09:05:05.982ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51192024-11-14T09:05:05.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6625b3b5-4ce9-4b3e-bbc7-b632fee70605", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
51202024-11-14T09:05:05.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51212024-11-14T09:05:05.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51222024-11-14T09:05:05.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51232024-11-14T09:05:05.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51242024-11-14T09:05:05.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51252024-11-14T09:05:05.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51262024-11-14T09:05:05.990ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51272024-11-14T09:05:05.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51282024-11-14T09:05:05.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ac7f87b1-dd93-412f-906d-be2bbd4f6a79", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
51292024-11-14T09:05:05.993ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 462.642683ms iteration = 16 status = {}
51302024-11-14T09:05:06.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b4f8ebe8-28bf-437b-ba35-d122f42b4ae4", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
51312024-11-14T09:05:06.148ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
51322024-11-14T09:05:06.148ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51332024-11-14T09:05:06.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d43dbfa-49c1-4f18-a17b-3a47c7750a10", "content-length": "682", "date": "Thu, 14 Nov 2024 09:05:05 GMT"} })
51342024-11-14T09:05:06.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51352024-11-14T09:05:06.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51362024-11-14T09:05:06.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51372024-11-14T09:05:06.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51382024-11-14T09:05:06.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51392024-11-14T09:05:06.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51402024-11-14T09:05:06.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51412024-11-14T09:05:06.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51422024-11-14T09:05:06.164ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 633.354976ms iteration = 15 status = {}
51432024-11-14T09:05:06.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 9af18b41-e464-4308-883b-81c9e73a2a4a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51442024-11-14T09:05:06.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 9af18b41-e464-4308-883b-81c9e73a2a4a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51452024-11-14T09:05:06.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 9af18b41-e464-4308-883b-81c9e73a2a4a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51462024-11-14T09:05:06.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0b38fdf9-4f4b-46a4-9b8a-2a28efc561c0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51472024-11-14T09:05:06.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0b38fdf9-4f4b-46a4-9b8a-2a28efc561c0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51482024-11-14T09:05:06.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0b38fdf9-4f4b-46a4-9b8a-2a28efc561c0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51492024-11-14T09:05:07.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92d98186-eeab-4259-8ec8-9095f84337fa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51502024-11-14T09:05:07.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92d98186-eeab-4259-8ec8-9095f84337fa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51512024-11-14T09:05:07.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92d98186-eeab-4259-8ec8-9095f84337fa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51522024-11-14T09:05:08.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 085d292a-2e06-4b71-bac3-6c174bd05f17 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51532024-11-14T09:05:08.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 085d292a-2e06-4b71-bac3-6c174bd05f17 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51542024-11-14T09:05:09.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 085d292a-2e06-4b71-bac3-6c174bd05f17 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51552024-11-14T09:05:10.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a663a0c-ac37-4f53-a607-0e619a800f2f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51562024-11-14T09:05:10.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a663a0c-ac37-4f53-a607-0e619a800f2f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51572024-11-14T09:05:10.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a663a0c-ac37-4f53-a607-0e619a800f2f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51582024-11-14T09:05:11.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ab826ecc-4c29-4738-a8c6-3f34e0559343 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51592024-11-14T09:05:11.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ab826ecc-4c29-4738-a8c6-3f34e0559343 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51602024-11-14T09:05:11.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ab826ecc-4c29-4738-a8c6-3f34e0559343 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51612024-11-14T09:05:12.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 26f20ead-eb9e-480d-bb79-230376c61360 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51622024-11-14T09:05:12.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 26f20ead-eb9e-480d-bb79-230376c61360 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51632024-11-14T09:05:12.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 26f20ead-eb9e-480d-bb79-230376c61360 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51642024-11-14T09:05:13.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c010d61-4bb7-4cab-b14d-0a7c2ef93e69 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51652024-11-14T09:05:13.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c010d61-4bb7-4cab-b14d-0a7c2ef93e69 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51662024-11-14T09:05:13.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c010d61-4bb7-4cab-b14d-0a7c2ef93e69 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51672024-11-14T09:05:14.049ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 7cae4f23-6b2e-41d4-b475-789910f54845 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
51682024-11-14T09:05:14.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 60f2706e-d601-4e41-a58a-3b3c6f376bd0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51692024-11-14T09:05:14.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 60f2706e-d601-4e41-a58a-3b3c6f376bd0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51702024-11-14T09:05:14.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 60f2706e-d601-4e41-a58a-3b3c6f376bd0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51712024-11-14T09:05:15.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a6e97ca7-6e4e-4e73-9c0c-0d6c2ac8bca2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51722024-11-14T09:05:15.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a6e97ca7-6e4e-4e73-9c0c-0d6c2ac8bca2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51732024-11-14T09:05:15.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a6e97ca7-6e4e-4e73-9c0c-0d6c2ac8bca2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51742024-11-14T09:05:15.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
51752024-11-14T09:05:15.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51762024-11-14T09:05:15.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
51772024-11-14T09:05:15.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51782024-11-14T09:05:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51792024-11-14T09:05:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51802024-11-14T09:05:15.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51812024-11-14T09:05:15.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51822024-11-14T09:05:15.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51832024-11-14T09:05:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51842024-11-14T09:05:15.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51852024-11-14T09:05:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51862024-11-14T09:05:15.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51872024-11-14T09:05:15.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51882024-11-14T09:05:15.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51892024-11-14T09:05:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
51902024-11-14T09:05:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51912024-11-14T09:05:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51922024-11-14T09:05:15.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
51932024-11-14T09:05:15.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.382067ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
51942024-11-14T09:05:15.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.204105ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51952024-11-14T09:05:16.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a04d8515-7893-4c44-a8ea-9b5482563877 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51962024-11-14T09:05:16.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a04d8515-7893-4c44-a8ea-9b5482563877 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51972024-11-14T09:05:16.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a04d8515-7893-4c44-a8ea-9b5482563877 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51982024-11-14T09:05:17.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fb87f225-0286-44e4-b909-0aab91960951 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
51992024-11-14T09:05:17.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fb87f225-0286-44e4-b909-0aab91960951 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52002024-11-14T09:05:17.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fb87f225-0286-44e4-b909-0aab91960951 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52012024-11-14T09:05:18.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 258a1bb0-1322-42e1-b663-32866d1d4065 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52022024-11-14T09:05:18.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 258a1bb0-1322-42e1-b663-32866d1d4065 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52032024-11-14T09:05:18.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 258a1bb0-1322-42e1-b663-32866d1d4065 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52042024-11-14T09:05:19.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68ab65a3-73dd-4a70-b2de-a61502b27b9f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52052024-11-14T09:05:19.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68ab65a3-73dd-4a70-b2de-a61502b27b9f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52062024-11-14T09:05:19.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68ab65a3-73dd-4a70-b2de-a61502b27b9f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52072024-11-14T09:05:20.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 70585e83-64e9-42bd-8d79-438b6bfe401a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52082024-11-14T09:05:20.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 70585e83-64e9-42bd-8d79-438b6bfe401a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52092024-11-14T09:05:20.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 70585e83-64e9-42bd-8d79-438b6bfe401a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52102024-11-14T09:05:21.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba886468-50f4-48c1-aa8e-c461a30322d1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52112024-11-14T09:05:21.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba886468-50f4-48c1-aa8e-c461a30322d1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52122024-11-14T09:05:21.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba886468-50f4-48c1-aa8e-c461a30322d1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52132024-11-14T09:05:22.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 64f4d2ae-711a-4e3a-9e96-1d4bdd0dba72 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52142024-11-14T09:05:22.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 64f4d2ae-711a-4e3a-9e96-1d4bdd0dba72 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52152024-11-14T09:05:22.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 64f4d2ae-711a-4e3a-9e96-1d4bdd0dba72 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52162024-11-14T09:05:23.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d8427d71-7c49-467c-812b-b79120dc495a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52172024-11-14T09:05:23.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d8427d71-7c49-467c-812b-b79120dc495a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52182024-11-14T09:05:23.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d8427d71-7c49-467c-812b-b79120dc495a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52192024-11-14T09:05:24.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cc80fdf0-07f3-4da7-a64f-61276eee9f5b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52202024-11-14T09:05:24.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cc80fdf0-07f3-4da7-a64f-61276eee9f5b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52212024-11-14T09:05:24.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cc80fdf0-07f3-4da7-a64f-61276eee9f5b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52222024-11-14T09:05:25.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a849746-c726-4229-88e0-d0af85ee4d71 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52232024-11-14T09:05:25.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a849746-c726-4229-88e0-d0af85ee4d71 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52242024-11-14T09:05:25.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a849746-c726-4229-88e0-d0af85ee4d71 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52252024-11-14T09:05:25.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
52262024-11-14T09:05:25.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52272024-11-14T09:05:25.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
52282024-11-14T09:05:25.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52292024-11-14T09:05:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52302024-11-14T09:05:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52312024-11-14T09:05:25.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52322024-11-14T09:05:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52332024-11-14T09:05:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52342024-11-14T09:05:25.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.250233ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52352024-11-14T09:05:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52362024-11-14T09:05:25.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52372024-11-14T09:05:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52382024-11-14T09:05:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52392024-11-14T09:05:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52402024-11-14T09:05:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412024-11-14T09:05:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
52422024-11-14T09:05:25.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52432024-11-14T09:05:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52442024-11-14T09:05:25.549ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
52452024-11-14T09:05:25.549ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.499397ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
52462024-11-14T09:05:26.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 85cfed5d-e44b-4671-a624-55a4db66a28f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52472024-11-14T09:05:26.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 85cfed5d-e44b-4671-a624-55a4db66a28f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52482024-11-14T09:05:26.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 85cfed5d-e44b-4671-a624-55a4db66a28f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52492024-11-14T09:05:27.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8819bf9-63d1-44fb-8a6d-1ceca396812b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52502024-11-14T09:05:27.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8819bf9-63d1-44fb-8a6d-1ceca396812b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52512024-11-14T09:05:27.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8819bf9-63d1-44fb-8a6d-1ceca396812b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52522024-11-14T09:05:28.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e03dcaba-4217-4040-a68c-3e0b7985eadf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52532024-11-14T09:05:28.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e03dcaba-4217-4040-a68c-3e0b7985eadf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52542024-11-14T09:05:28.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e03dcaba-4217-4040-a68c-3e0b7985eadf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52552024-11-14T09:05:29.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1508 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 35e2a15e-8e17-466b-8d19-eb2b08678bbf response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
52562024-11-14T09:05:29.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 71e0a413-7cc1-4441-924f-064baaef2524 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52572024-11-14T09:05:29.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 71e0a413-7cc1-4441-924f-064baaef2524 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52582024-11-14T09:05:29.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 71e0a413-7cc1-4441-924f-064baaef2524 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52592024-11-14T09:05:30.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bb1c0913-7b62-4b81-aa27-08dab07a5704 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52602024-11-14T09:05:30.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bb1c0913-7b62-4b81-aa27-08dab07a5704 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52612024-11-14T09:05:30.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bb1c0913-7b62-4b81-aa27-08dab07a5704 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52622024-11-14T09:05:31.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3cf634dd-b13a-4e56-948b-1a439120e89d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52632024-11-14T09:05:31.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3cf634dd-b13a-4e56-948b-1a439120e89d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52642024-11-14T09:05:31.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3cf634dd-b13a-4e56-948b-1a439120e89d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52652024-11-14T09:05:32.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9860bb54-1013-4233-beef-75903e7eccb0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52662024-11-14T09:05:32.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9860bb54-1013-4233-beef-75903e7eccb0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52672024-11-14T09:05:32.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9860bb54-1013-4233-beef-75903e7eccb0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52682024-11-14T09:05:33.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73316e1c-7403-43d6-ae4d-1ce9376fd221 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52692024-11-14T09:05:33.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73316e1c-7403-43d6-ae4d-1ce9376fd221 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52702024-11-14T09:05:33.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73316e1c-7403-43d6-ae4d-1ce9376fd221 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52712024-11-14T09:05:34.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cce1d167-74fb-4a2c-812d-a7c0d823a0c8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52722024-11-14T09:05:34.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cce1d167-74fb-4a2c-812d-a7c0d823a0c8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52732024-11-14T09:05:34.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cce1d167-74fb-4a2c-812d-a7c0d823a0c8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
52742024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
52752024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
52762024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52772024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
52782024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
52792024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
52802024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52812024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52822024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52832024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
52842024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
52852024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52862024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
52872024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52882024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52892024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
52902024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52912024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
52922024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
52932024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52942024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52952024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52962024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
52972024-11-14T09:05:35.531ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52982024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
52992024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53002024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53012024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53022024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53032024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53042024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53052024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53062024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
53072024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
53082024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53092024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53102024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53112024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
53122024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
53132024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53142024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53152024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53162024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53172024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53182024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53192024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53202024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53212024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53222024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53232024-11-14T09:05:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53242024-11-14T09:05:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53252024-11-14T09:05:35.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262024-11-14T09:05:35.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53272024-11-14T09:05:35.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53282024-11-14T09:05:35.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.968204ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53292024-11-14T09:05:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53302024-11-14T09:05:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53312024-11-14T09:05:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53322024-11-14T09:05:35.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53332024-11-14T09:05:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53342024-11-14T09:05:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53352024-11-14T09:05:35.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53362024-11-14T09:05:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53372024-11-14T09:05:35.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53382024-11-14T09:05:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53392024-11-14T09:05:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53402024-11-14T09:05:35.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53412024-11-14T09:05:35.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53422024-11-14T09:05:35.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 329417855 } })
53432024-11-14T09:05:35.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
53442024-11-14T09:05:35.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 329998724 } })
53452024-11-14T09:05:35.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
53462024-11-14T09:05:35.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.459544ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
53472024-11-14T09:05:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53482024-11-14T09:05:35.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53492024-11-14T09:05:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53502024-11-14T09:05:35.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53512024-11-14T09:05:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53522024-11-14T09:05:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53532024-11-14T09:05:35.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.393639ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
53542024-11-14T09:05:35.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53552024-11-14T09:05:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53562024-11-14T09:05:35.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.036942ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53572024-11-14T09:05:35.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53582024-11-14T09:05:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53592024-11-14T09:05:35.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53602024-11-14T09:05:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53612024-11-14T09:05:35.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53622024-11-14T09:05:35.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53632024-11-14T09:05:35.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 343926758 } })
53642024-11-14T09:05:35.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
53652024-11-14T09:05:35.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53662024-11-14T09:05:35.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53672024-11-14T09:05:35.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53682024-11-14T09:05:35.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53692024-11-14T09:05:35.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53702024-11-14T09:05:35.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53712024-11-14T09:05:35.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53722024-11-14T09:05:35.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53732024-11-14T09:05:35.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742024-11-14T09:05:35.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53752024-11-14T09:05:35.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53762024-11-14T09:05:35.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53772024-11-14T09:05:35.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53782024-11-14T09:05:35.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53792024-11-14T09:05:35.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802024-11-14T09:05:35.575ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53812024-11-14T09:05:35.575ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53822024-11-14T09:05:35.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53832024-11-14T09:05:35.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53842024-11-14T09:05:35.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53852024-11-14T09:05:35.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53862024-11-14T09:05:35.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53872024-11-14T09:05:35.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53882024-11-14T09:05:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53892024-11-14T09:05:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
53902024-11-14T09:05:35.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53912024-11-14T09:05:35.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53922024-11-14T09:05:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53932024-11-14T09:05:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53942024-11-14T09:05:35.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53952024-11-14T09:05:35.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53962024-11-14T09:05:35.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53972024-11-14T09:05:35.581ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.683415ms iteration = 16 status = 0
53982024-11-14T09:05:35.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53992024-11-14T09:05:35.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54002024-11-14T09:05:35.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54012024-11-14T09:05:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54022024-11-14T09:05:35.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54032024-11-14T09:05:35.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54042024-11-14T09:05:35.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54052024-11-14T09:05:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54062024-11-14T09:05:35.588ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54072024-11-14T09:05:35.588ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.710007ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54082024-11-14T09:05:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
54092024-11-14T09:05:35.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54102024-11-14T09:05:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54112024-11-14T09:05:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54122024-11-14T09:05:35.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54132024-11-14T09:05:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54142024-11-14T09:05:35.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.480792ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54152024-11-14T09:05:35.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3c117921-0279-4c51-9f9b-c5a5538f4a66 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
54162024-11-14T09:05:35.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3c117921-0279-4c51-9f9b-c5a5538f4a66 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
54172024-11-14T09:05:35.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
54182024-11-14T09:05:35.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.464102ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
54192024-11-14T09:05:35.609ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54202024-11-14T09:05:35.610ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54212024-11-14T09:05:35.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54222024-11-14T09:05:35.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54232024-11-14T09:05:35.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.114242ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54242024-11-14T09:05:35.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.822673ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54252024-11-14T09:05:35.627ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.569432ms iteration = 19 status = {"physical_disks_added":0}
54262024-11-14T09:05:35.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
54272024-11-14T09:05:35.642ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54282024-11-14T09:05:35.642ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63abf9ba-315a-4b2f-a3cb-f5fb31b59b42", "content-length": "26", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54292024-11-14T09:05:35.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54302024-11-14T09:05:35.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54312024-11-14T09:05:35.647ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
54322024-11-14T09:05:35.647ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54332024-11-14T09:05:35.647ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5c857bc-4c01-4810-aeeb-391c3f349975", "content-length": "26", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54342024-11-14T09:05:35.647ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54352024-11-14T09:05:35.649ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54362024-11-14T09:05:35.739ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54372024-11-14T09:05:35.739ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54382024-11-14T09:05:35.740ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a53289e-b4ab-4f0a-b30f-6cee2bfb50b4", "content-length": "372", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54392024-11-14T09:05:35.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54402024-11-14T09:05:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54412024-11-14T09:05:35.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3c117921-0279-4c51-9f9b-c5a5538f4a66 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
54422024-11-14T09:05:35.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54432024-11-14T09:05:35.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54442024-11-14T09:05:35.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 211.416137ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54452024-11-14T09:05:35.754ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
54462024-11-14T09:05:35.754ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54472024-11-14T09:05:35.754ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5cfa7448-f3a7-4c77-b3fb-e42ce584b9b7", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54482024-11-14T09:05:35.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54492024-11-14T09:05:35.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54502024-11-14T09:05:35.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54512024-11-14T09:05:35.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54522024-11-14T09:05:35.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54532024-11-14T09:05:35.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54542024-11-14T09:05:35.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
54552024-11-14T09:05:35.797ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54562024-11-14T09:05:35.797ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1c3652f-babd-491d-8543-fb61d4ec1785", "content-length": "26", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54572024-11-14T09:05:35.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54582024-11-14T09:05:35.798ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
54592024-11-14T09:05:35.813ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54602024-11-14T09:05:35.813ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a66b8a8-f945-4f63-8672-a481ea3f4766", "content-length": "691", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54612024-11-14T09:05:35.813ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54622024-11-14T09:05:35.813ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54632024-11-14T09:05:35.813ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54642024-11-14T09:05:35.815ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.093045ms iteration = 16 status = {}
54652024-11-14T09:05:35.815ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54662024-11-14T09:05:35.815ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54672024-11-14T09:05:35.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2d3319f0-8331-45ef-be44-a5a300f200eb", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
54682024-11-14T09:05:35.817ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 286.294199ms iteration = 17 status = {}
54692024-11-14T09:05:35.924ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 393.252729ms iteration = 16 status = {}
54702024-11-14T09:05:35.943ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54712024-11-14T09:05:35.944ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d91dd8-9f3e-483f-ab63-1482c9e1b717", "content-length": "1", "date": "Thu, 14 Nov 2024 09:05:34 GMT"} })
54722024-11-14T09:05:35.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54732024-11-14T09:05:35.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54742024-11-14T09:05:35.947ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 416.554263ms iteration = 16 status = null
54752024-11-14T09:05:36.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54762024-11-14T09:05:36.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54772024-11-14T09:05:36.018ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
54782024-11-14T09:05:36.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54792024-11-14T09:05:36.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54802024-11-14T09:05:36.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54812024-11-14T09:05:36.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "74fc9bd9-7554-4365-bfa2-966b9ef6158d", "content-length": "134", "date": "Thu, 14 Nov 2024 09:05:36 GMT"} })
54822024-11-14T09:05:36.028ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54832024-11-14T09:05:36.028ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
54842024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54852024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54862024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54872024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54882024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54892024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54902024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54912024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54922024-11-14T09:05:36.029ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
54932024-11-14T09:05:36.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54942024-11-14T09:05:36.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54952024-11-14T09:05:36.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54962024-11-14T09:05:36.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf0ca08e-f5ba-48e5-9805-72849f08a93c", "content-length": "2", "date": "Thu, 14 Nov 2024 09:05:36 GMT"} })
54972024-11-14T09:05:36.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54982024-11-14T09:05:36.032ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bbf584e-e867-4ba4-b916-30bf97ba84fe", "content-length": "52", "date": "Thu, 14 Nov 2024 09:05:36 GMT"} })
54992024-11-14T09:05:36.032ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
55002024-11-14T09:05:36.032ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55012024-11-14T09:05:36.130ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "09619b58-fdf3-4a44-9301-bf36a7f2beff", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
55022024-11-14T09:05:36.130ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
55032024-11-14T09:05:36.130ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55042024-11-14T09:05:36.131ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6242232a-de84-423e-9c9e-8b103852e81b", "content-length": "682", "date": "Thu, 14 Nov 2024 09:05:35 GMT"} })
55052024-11-14T09:05:36.131ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55062024-11-14T09:05:36.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55072024-11-14T09:05:36.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55082024-11-14T09:05:36.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55092024-11-14T09:05:36.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55102024-11-14T09:05:36.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55112024-11-14T09:05:36.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55122024-11-14T09:05:36.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55132024-11-14T09:05:36.152ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 621.778359ms iteration = 16 status = {}
55142024-11-14T09:05:36.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3a2ee748-a54b-4190-87e2-265c09ce8c46 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55152024-11-14T09:05:36.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3a2ee748-a54b-4190-87e2-265c09ce8c46 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55162024-11-14T09:05:36.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3a2ee748-a54b-4190-87e2-265c09ce8c46 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55172024-11-14T09:05:36.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3e675275-090a-471b-9b8f-0f9089633d37 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55182024-11-14T09:05:36.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3e675275-090a-471b-9b8f-0f9089633d37 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55192024-11-14T09:05:36.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3e675275-090a-471b-9b8f-0f9089633d37 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55202024-11-14T09:05:37.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c26ce9af-0936-4045-b6f0-7348d9d7c53e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55212024-11-14T09:05:37.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c26ce9af-0936-4045-b6f0-7348d9d7c53e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55222024-11-14T09:05:37.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c26ce9af-0936-4045-b6f0-7348d9d7c53e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55232024-11-14T09:05:38.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 336dcd7d-564f-47fb-8c1c-cf27342aeec8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55242024-11-14T09:05:38.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 336dcd7d-564f-47fb-8c1c-cf27342aeec8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55252024-11-14T09:05:38.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 336dcd7d-564f-47fb-8c1c-cf27342aeec8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55262024-11-14T09:05:39.018ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35534
55272024-11-14T09:05:39.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35534 req_id = 63c73a5e-ffb7-4203-a4bb-99ba3f8df210 roles = RoleSet { roles: {} } uri = /metrics/producers
55282024-11-14T09:05:39.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35534 req_id = 63c73a5e-ffb7-4203-a4bb-99ba3f8df210 resource = Database result = Ok(()) uri = /metrics/producers
55292024-11-14T09:05:39.055ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 90e4e05f-b4bf-4b2e-9770-f73b3d2c05fa
55302024-11-14T09:05:39.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36980 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35534 req_id = 63c73a5e-ffb7-4203-a4bb-99ba3f8df210 response_code = 201 uri = /metrics/producers
55312024-11-14T09:05:39.759ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:39579
55322024-11-14T09:05:39.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39579 req_id = e5e40ac6-a1a6-4cdc-ab9e-ce05c62897b9 roles = RoleSet { roles: {} } uri = /metrics/producers
55332024-11-14T09:05:39.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39579 req_id = e5e40ac6-a1a6-4cdc-ab9e-ce05c62897b9 resource = Database result = Ok(()) uri = /metrics/producers
55342024-11-14T09:05:39.799ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 0a0adcc5-bcdd-46d2-a222-ace3abfe409c
55352024-11-14T09:05:39.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40541 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39579 req_id = e5e40ac6-a1a6-4cdc-ab9e-ce05c62897b9 response_code = 201 uri = /metrics/producers
55362024-11-14T09:05:39.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 27362033-cec4-40a1-ae38-df1581f90c25 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55372024-11-14T09:05:39.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 27362033-cec4-40a1-ae38-df1581f90c25 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55382024-11-14T09:05:39.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 27362033-cec4-40a1-ae38-df1581f90c25 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55392024-11-14T09:05:40.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 85ea1db5-e8a3-485d-b9a6-83a0a6174771 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55402024-11-14T09:05:40.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 85ea1db5-e8a3-485d-b9a6-83a0a6174771 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55412024-11-14T09:05:40.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 85ea1db5-e8a3-485d-b9a6-83a0a6174771 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55422024-11-14T09:05:41.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba2d9ce2-153c-43ef-b015-a347b5dad710 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55432024-11-14T09:05:41.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba2d9ce2-153c-43ef-b015-a347b5dad710 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55442024-11-14T09:05:41.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba2d9ce2-153c-43ef-b015-a347b5dad710 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55452024-11-14T09:05:42.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7dc22178-f41e-475e-b362-eae468c707ef roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55462024-11-14T09:05:42.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7dc22178-f41e-475e-b362-eae468c707ef resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55472024-11-14T09:05:42.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7dc22178-f41e-475e-b362-eae468c707ef response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55482024-11-14T09:05:43.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65f27544-b12d-416e-82ea-8254c496c4ea roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55492024-11-14T09:05:43.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65f27544-b12d-416e-82ea-8254c496c4ea resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55502024-11-14T09:05:43.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65f27544-b12d-416e-82ea-8254c496c4ea response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55512024-11-14T09:05:44.048ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1614 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 7d7bae62-6694-4aa8-858c-68d6796e2a47 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
55522024-11-14T09:05:44.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2c1f964-4dc4-4e64-85fd-58416f6a6422 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55532024-11-14T09:05:44.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2c1f964-4dc4-4e64-85fd-58416f6a6422 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55542024-11-14T09:05:44.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2c1f964-4dc4-4e64-85fd-58416f6a6422 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55552024-11-14T09:05:45.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
55562024-11-14T09:05:45.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
55572024-11-14T09:05:45.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55582024-11-14T09:05:45.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55592024-11-14T09:05:45.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55602024-11-14T09:05:45.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55612024-11-14T09:05:45.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55622024-11-14T09:05:45.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55632024-11-14T09:05:45.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55642024-11-14T09:05:45.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55652024-11-14T09:05:45.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55662024-11-14T09:05:45.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55672024-11-14T09:05:45.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55682024-11-14T09:05:45.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55692024-11-14T09:05:45.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55702024-11-14T09:05:45.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
55712024-11-14T09:05:45.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55722024-11-14T09:05:45.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55732024-11-14T09:05:45.587ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
55742024-11-14T09:05:45.587ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.163542ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
55752024-11-14T09:05:45.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.900778ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55762024-11-14T09:05:45.701ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62140
55772024-11-14T09:05:45.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62140 req_id = 981f408d-c6de-4841-a3fb-0be546900a1d roles = RoleSet { roles: {} } uri = /metrics/producers
55782024-11-14T09:05:45.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62140 req_id = 981f408d-c6de-4841-a3fb-0be546900a1d resource = Database result = Ok(()) uri = /metrics/producers
55792024-11-14T09:05:45.744ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 4ceca43a-03cf-4e69-8d70-2c7628b44304
55802024-11-14T09:05:45.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42797 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62140 req_id = 981f408d-c6de-4841-a3fb-0be546900a1d response_code = 201 uri = /metrics/producers
55812024-11-14T09:05:45.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8eeedf2-0eb0-46cf-b8aa-be5b77970310 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55822024-11-14T09:05:45.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8eeedf2-0eb0-46cf-b8aa-be5b77970310 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55832024-11-14T09:05:45.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b8eeedf2-0eb0-46cf-b8aa-be5b77970310 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55842024-11-14T09:05:46.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62093bee-cf05-4fa5-a336-fce195ea7952 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55852024-11-14T09:05:46.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62093bee-cf05-4fa5-a336-fce195ea7952 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55862024-11-14T09:05:47.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62093bee-cf05-4fa5-a336-fce195ea7952 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55872024-11-14T09:05:47.149ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49606
55882024-11-14T09:05:47.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49606 req_id = 7715a6f0-1ed2-4fbb-b52c-0a4174e6c87b roles = RoleSet { roles: {} } uri = /metrics/producers
55892024-11-14T09:05:47.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49606 req_id = 7715a6f0-1ed2-4fbb-b52c-0a4174e6c87b resource = Database result = Ok(()) uri = /metrics/producers
55902024-11-14T09:05:47.162ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 65d2236a-3110-4d84-aa25-77e21779db87
55912024-11-14T09:05:47.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12446 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49606 req_id = 7715a6f0-1ed2-4fbb-b52c-0a4174e6c87b response_code = 201 uri = /metrics/producers
55922024-11-14T09:05:48.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3ca1af28-4533-442c-9936-a732ed4ee8cb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55932024-11-14T09:05:48.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3ca1af28-4533-442c-9936-a732ed4ee8cb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55942024-11-14T09:05:48.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3ca1af28-4533-442c-9936-a732ed4ee8cb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
55952024-11-14T09:05:48.735ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48005
55962024-11-14T09:05:48.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48005 req_id = cdbf40b3-1495-44ef-8cc5-c868c64ba8cf roles = RoleSet { roles: {} } uri = /metrics/producers
55972024-11-14T09:05:48.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48005 req_id = cdbf40b3-1495-44ef-8cc5-c868c64ba8cf resource = Database result = Ok(()) uri = /metrics/producers
55982024-11-14T09:05:48.745ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 92786f50-3ada-49c6-9f91-967466d8804f
55992024-11-14T09:05:48.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9442 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48005 req_id = cdbf40b3-1495-44ef-8cc5-c868c64ba8cf response_code = 201 uri = /metrics/producers
56002024-11-14T09:05:49.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 04a018bd-bc39-4008-97a2-e50a0cbfcbd5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56012024-11-14T09:05:49.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 04a018bd-bc39-4008-97a2-e50a0cbfcbd5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56022024-11-14T09:05:49.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 04a018bd-bc39-4008-97a2-e50a0cbfcbd5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56032024-11-14T09:05:50.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e2d9182-03e6-410f-b33a-e8d7e29e1500 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56042024-11-14T09:05:50.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e2d9182-03e6-410f-b33a-e8d7e29e1500 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56052024-11-14T09:05:50.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e2d9182-03e6-410f-b33a-e8d7e29e1500 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56062024-11-14T09:05:50.825ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33406
56072024-11-14T09:05:50.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33406 req_id = 8fe316c8-bc92-49b9-b0a9-20da68e9962c roles = RoleSet { roles: {} } uri = /metrics/producers
56082024-11-14T09:05:50.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33406 req_id = 8fe316c8-bc92-49b9-b0a9-20da68e9962c resource = Database result = Ok(()) uri = /metrics/producers
56092024-11-14T09:05:50.835ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = c91f550b-068d-4077-a493-b226555a9b58
56102024-11-14T09:05:50.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9585 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33406 req_id = 8fe316c8-bc92-49b9-b0a9-20da68e9962c response_code = 201 uri = /metrics/producers
56112024-11-14T09:05:51.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 165710eb-a6c1-444e-9564-dfda5d8d0d66 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56122024-11-14T09:05:51.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 165710eb-a6c1-444e-9564-dfda5d8d0d66 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56132024-11-14T09:05:51.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 165710eb-a6c1-444e-9564-dfda5d8d0d66 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56142024-11-14T09:05:51.170ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
56152024-11-14T09:05:51.170ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
56162024-11-14T09:05:51.201ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
56172024-11-14T09:05:51.201ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:48557
56182024-11-14T09:05:51.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48557 req_id = 46f9f98d-2fe7-4fb9-aae7-3e9d22faa4fd roles = RoleSet { roles: {} } uri = /metrics/producers
56192024-11-14T09:05:51.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48557 req_id = 46f9f98d-2fe7-4fb9-aae7-3e9d22faa4fd resource = Database result = Ok(()) uri = /metrics/producers
56202024-11-14T09:05:51.216ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 484a1c50-302f-49ec-9214-2179c2ff7104
56212024-11-14T09:05:51.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14704 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48557 req_id = 46f9f98d-2fe7-4fb9-aae7-3e9d22faa4fd response_code = 201 uri = /metrics/producers
56222024-11-14T09:05:51.216ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "46f9f98d-2fe7-4fb9-aae7-3e9d22faa4fd", "content-length": "41", "date": "Thu, 14 Nov 2024 09:05:50 GMT"} })
56232024-11-14T09:05:51.217ZDEBGnexus (producer-registration-task): registered with nexus successfully
56242024-11-14T09:05:51.217ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
56252024-11-14T09:05:52.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc00d34b-00a4-4e46-b85f-83f11b188510 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56262024-11-14T09:05:52.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc00d34b-00a4-4e46-b85f-83f11b188510 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56272024-11-14T09:05:52.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc00d34b-00a4-4e46-b85f-83f11b188510 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56282024-11-14T09:05:53.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a70fc7d5-afc6-46de-b038-5b8597e947c0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56292024-11-14T09:05:53.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a70fc7d5-afc6-46de-b038-5b8597e947c0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56302024-11-14T09:05:53.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a70fc7d5-afc6-46de-b038-5b8597e947c0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56312024-11-14T09:05:54.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dbe0838b-0f1e-4c75-b2cc-b0c898f49497 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56322024-11-14T09:05:54.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dbe0838b-0f1e-4c75-b2cc-b0c898f49497 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56332024-11-14T09:05:54.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dbe0838b-0f1e-4c75-b2cc-b0c898f49497 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56342024-11-14T09:05:55.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 151104b8-6306-4af8-9d86-eb0f9f0bf92e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56352024-11-14T09:05:55.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 151104b8-6306-4af8-9d86-eb0f9f0bf92e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56362024-11-14T09:05:55.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 151104b8-6306-4af8-9d86-eb0f9f0bf92e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56372024-11-14T09:05:55.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
56382024-11-14T09:05:55.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
56392024-11-14T09:05:55.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-11-14T09:05:55.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56412024-11-14T09:05:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56422024-11-14T09:05:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56432024-11-14T09:05:55.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442024-11-14T09:05:55.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56452024-11-14T09:05:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56462024-11-14T09:05:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56472024-11-14T09:05:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56482024-11-14T09:05:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56492024-11-14T09:05:55.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.248484ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56502024-11-14T09:05:55.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56512024-11-14T09:05:55.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56522024-11-14T09:05:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56532024-11-14T09:05:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
56542024-11-14T09:05:55.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56552024-11-14T09:05:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56562024-11-14T09:05:55.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
56572024-11-14T09:05:55.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.729425ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
56582024-11-14T09:05:56.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f12a1cb3-18ea-436e-a2a6-dbf193f4f7b8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56592024-11-14T09:05:56.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f12a1cb3-18ea-436e-a2a6-dbf193f4f7b8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56602024-11-14T09:05:56.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f12a1cb3-18ea-436e-a2a6-dbf193f4f7b8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56612024-11-14T09:05:57.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0e0e3ef6-305b-4c0e-b58e-7c67fe0503d8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56622024-11-14T09:05:57.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0e0e3ef6-305b-4c0e-b58e-7c67fe0503d8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56632024-11-14T09:05:57.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0e0e3ef6-305b-4c0e-b58e-7c67fe0503d8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56642024-11-14T09:05:58.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d57392b-9301-463c-9083-56d67166e02c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56652024-11-14T09:05:58.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d57392b-9301-463c-9083-56d67166e02c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56662024-11-14T09:05:58.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d57392b-9301-463c-9083-56d67166e02c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56672024-11-14T09:05:59.048ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 42f33167-bba7-4136-933d-71cac3852e79 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
56682024-11-14T09:05:59.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28bc1956-d2d2-491f-9e8c-e2a1840502b7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56692024-11-14T09:05:59.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28bc1956-d2d2-491f-9e8c-e2a1840502b7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56702024-11-14T09:05:59.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28bc1956-d2d2-491f-9e8c-e2a1840502b7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56712024-11-14T09:06:00.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44b34240-b6b0-4865-b01b-de7f9868aeec roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56722024-11-14T09:06:00.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44b34240-b6b0-4865-b01b-de7f9868aeec resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56732024-11-14T09:06:00.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44b34240-b6b0-4865-b01b-de7f9868aeec response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56742024-11-14T09:06:01.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 94ad01f2-70bf-4964-9dce-bfc320afebc7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56752024-11-14T09:06:01.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 94ad01f2-70bf-4964-9dce-bfc320afebc7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56762024-11-14T09:06:01.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 94ad01f2-70bf-4964-9dce-bfc320afebc7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56772024-11-14T09:06:02.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66059d03-1c42-4c70-9b68-2310e251a138 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56782024-11-14T09:06:02.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66059d03-1c42-4c70-9b68-2310e251a138 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56792024-11-14T09:06:02.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 66059d03-1c42-4c70-9b68-2310e251a138 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56802024-11-14T09:06:03.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09be0592-91d7-4f4f-beb3-a86d70f86f29 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56812024-11-14T09:06:03.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09be0592-91d7-4f4f-beb3-a86d70f86f29 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56822024-11-14T09:06:03.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09be0592-91d7-4f4f-beb3-a86d70f86f29 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56832024-11-14T09:06:04.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 424b0806-20ef-433e-9687-7ab7b9492d55 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56842024-11-14T09:06:04.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 424b0806-20ef-433e-9687-7ab7b9492d55 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56852024-11-14T09:06:04.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 424b0806-20ef-433e-9687-7ab7b9492d55 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56862024-11-14T09:06:05.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f980fbd2-c5f1-4ba0-ae8f-4f6e364895c7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56872024-11-14T09:06:05.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f980fbd2-c5f1-4ba0-ae8f-4f6e364895c7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56882024-11-14T09:06:05.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f980fbd2-c5f1-4ba0-ae8f-4f6e364895c7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
56892024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
56902024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56912024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
56922024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
56932024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56942024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
56952024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
56962024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
56972024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56982024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
56992024-11-14T09:06:05.531ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57002024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57012024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57022024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
57032024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57042024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
57052024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57062024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
57072024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57082024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57092024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
57102024-11-14T09:06:05.531ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
57112024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.571\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
57122024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
57132024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
57142024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57152024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57162024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
57172024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
57182024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57192024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
57202024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
57212024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57222024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57232024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
57242024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57252024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
57262024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57272024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57282024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
57292024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
57302024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
57312024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57322024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57332024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
57342024-11-14T09:06:05.531ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57352024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57362024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
57372024-11-14T09:06:05.531ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:56:05.531466168 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57382024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57392024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57402024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57412024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57422024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57432024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57442024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57452024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
57462024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
57472024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
57482024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
57492024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57502024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57512024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57522024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
57532024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57542024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57552024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
57562024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57572024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57582024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57592024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57602024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57612024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57622024-11-14T09:06:05.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57632024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57642024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57652024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57662024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57672024-11-14T09:06:05.532ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 318820884 } })
57682024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57692024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57702024-11-14T09:06:05.532ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 318999937 } })
57712024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57722024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57732024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57742024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57752024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57762024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57772024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
57782024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.262651ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
57792024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
57802024-11-14T09:06:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.345791ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
57812024-11-14T09:06:05.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-11-14T09:06:05.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-11-14T09:06:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.930279ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57842024-11-14T09:06:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57852024-11-14T09:06:05.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57862024-11-14T09:06:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57872024-11-14T09:06:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57882024-11-14T09:06:05.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57892024-11-14T09:06:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57902024-11-14T09:06:05.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57912024-11-14T09:06:05.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-14T09:06:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57932024-11-14T09:06:05.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57942024-11-14T09:06:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57952024-11-14T09:06:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57962024-11-14T09:06:05.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57972024-11-14T09:06:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57982024-11-14T09:06:05.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57992024-11-14T09:06:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58002024-11-14T09:06:05.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58012024-11-14T09:06:05.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58022024-11-14T09:06:05.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 333891737 } })
58032024-11-14T09:06:05.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
58042024-11-14T09:06:05.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58052024-11-14T09:06:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58062024-11-14T09:06:05.550ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:56:05.531466168 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58072024-11-14T09:06:05.550ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.24642ms iteration = 9 status = {"expiration":"2024-11-14T08:56:05.531466168Z","pruned":[]}
58082024-11-14T09:06:05.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 338800025 } })
58092024-11-14T09:06:05.552ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.213084ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
58102024-11-14T09:06:05.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
58112024-11-14T09:06:05.554ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 341153033 } })
58122024-11-14T09:06:05.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
58132024-11-14T09:06:05.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58142024-11-14T09:06:05.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58152024-11-14T09:06:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58162024-11-14T09:06:05.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58172024-11-14T09:06:05.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58182024-11-14T09:06:05.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58192024-11-14T09:06:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58202024-11-14T09:06:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58212024-11-14T09:06:05.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58222024-11-14T09:06:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58232024-11-14T09:06:05.566ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
58242024-11-14T09:06:05.566ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 34.762619ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
58252024-11-14T09:06:05.573ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 42.023445ms iteration = 20 status = {"physical_disks_added":0}
58262024-11-14T09:06:05.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58272024-11-14T09:06:05.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282024-11-14T09:06:05.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58292024-11-14T09:06:05.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58302024-11-14T09:06:05.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58312024-11-14T09:06:05.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58322024-11-14T09:06:05.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58332024-11-14T09:06:05.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58342024-11-14T09:06:05.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58352024-11-14T09:06:05.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58362024-11-14T09:06:05.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58372024-11-14T09:06:05.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58382024-11-14T09:06:05.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58392024-11-14T09:06:05.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
58402024-11-14T09:06:05.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58412024-11-14T09:06:05.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58422024-11-14T09:06:05.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58432024-11-14T09:06:05.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58442024-11-14T09:06:05.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-11-14T09:06:05.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58462024-11-14T09:06:05.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58472024-11-14T09:06:05.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58482024-11-14T09:06:05.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.847112ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
58492024-11-14T09:06:05.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502024-11-14T09:06:05.599ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58512024-11-14T09:06:05.599ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.553171ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58522024-11-14T09:06:05.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.886737ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
58532024-11-14T09:06:05.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58542024-11-14T09:06:05.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58552024-11-14T09:06:05.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58562024-11-14T09:06:05.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58572024-11-14T09:06:05.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58582024-11-14T09:06:05.602ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58592024-11-14T09:06:05.602ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58602024-11-14T09:06:05.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58612024-11-14T09:06:05.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58622024-11-14T09:06:05.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58632024-11-14T09:06:05.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58642024-11-14T09:06:05.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58652024-11-14T09:06:05.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58662024-11-14T09:06:05.604ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58672024-11-14T09:06:05.605ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58682024-11-14T09:06:05.605ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.133965ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58692024-11-14T09:06:05.605ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58702024-11-14T09:06:05.605ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58712024-11-14T09:06:05.605ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.742251ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58722024-11-14T09:06:05.606ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58732024-11-14T09:06:05.606ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58742024-11-14T09:06:05.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58752024-11-14T09:06:05.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58762024-11-14T09:06:05.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58772024-11-14T09:06:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58782024-11-14T09:06:05.611ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58792024-11-14T09:06:05.611ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58802024-11-14T09:06:05.611ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58812024-11-14T09:06:05.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58822024-11-14T09:06:05.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58832024-11-14T09:06:05.615ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
58842024-11-14T09:06:05.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.00222ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
58852024-11-14T09:06:05.616ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58862024-11-14T09:06:05.616ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58872024-11-14T09:06:05.616ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58882024-11-14T09:06:05.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58892024-11-14T09:06:05.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58902024-11-14T09:06:05.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58912024-11-14T09:06:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58922024-11-14T09:06:05.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58932024-11-14T09:06:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58942024-11-14T09:06:05.627ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58952024-11-14T09:06:05.627ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58962024-11-14T09:06:05.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58972024-11-14T09:06:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58982024-11-14T09:06:05.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58992024-11-14T09:06:05.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.644551ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59002024-11-14T09:06:05.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59012024-11-14T09:06:05.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59022024-11-14T09:06:05.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59032024-11-14T09:06:05.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59042024-11-14T09:06:05.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59052024-11-14T09:06:05.634ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
59062024-11-14T09:06:05.634ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59072024-11-14T09:06:05.634ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
59082024-11-14T09:06:05.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 103.462802ms iteration = 10 status = {"generation":1}
59092024-11-14T09:06:05.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59102024-11-14T09:06:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59112024-11-14T09:06:05.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59122024-11-14T09:06:05.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
59132024-11-14T09:06:05.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59142024-11-14T09:06:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59152024-11-14T09:06:05.643ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 111.953429ms iteration = 17 status = 0
59162024-11-14T09:06:05.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172024-11-14T09:06:05.645ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59182024-11-14T09:06:05.645ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59192024-11-14T09:06:05.645ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.074823ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59202024-11-14T09:06:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59212024-11-14T09:06:05.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59222024-11-14T09:06:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59232024-11-14T09:06:05.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59242024-11-14T09:06:05.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59252024-11-14T09:06:05.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262024-11-14T09:06:05.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59272024-11-14T09:06:05.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59282024-11-14T09:06:05.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59292024-11-14T09:06:05.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59302024-11-14T09:06:05.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59312024-11-14T09:06:05.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59322024-11-14T09:06:05.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59332024-11-14T09:06:05.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59342024-11-14T09:06:05.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.113626ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59352024-11-14T09:06:05.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.612982ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59362024-11-14T09:06:05.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59372024-11-14T09:06:05.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59382024-11-14T09:06:05.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59392024-11-14T09:06:05.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.190884ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59402024-11-14T09:06:05.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59412024-11-14T09:06:05.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59422024-11-14T09:06:05.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59432024-11-14T09:06:05.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59442024-11-14T09:06:05.679ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59452024-11-14T09:06:05.679ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
59462024-11-14T09:06:05.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59472024-11-14T09:06:05.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59482024-11-14T09:06:05.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59492024-11-14T09:06:05.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59502024-11-14T09:06:05.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59512024-11-14T09:06:05.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59522024-11-14T09:06:05.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59532024-11-14T09:06:05.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59542024-11-14T09:06:05.717ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
59552024-11-14T09:06:05.717ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.609088ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59562024-11-14T09:06:05.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59572024-11-14T09:06:05.725ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59582024-11-14T09:06:05.725ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4833c96-e851-49fb-ace4-72c802fbceee", "content-length": "26", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
59592024-11-14T09:06:05.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59602024-11-14T09:06:05.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59612024-11-14T09:06:05.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59622024-11-14T09:06:05.728ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59632024-11-14T09:06:05.729ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b802c7c-c506-4b68-942a-ca0ad128623c", "content-length": "26", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
59642024-11-14T09:06:05.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59652024-11-14T09:06:05.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59662024-11-14T09:06:05.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
59672024-11-14T09:06:05.731ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59682024-11-14T09:06:05.732ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9a762ca-87b2-4c9d-a76d-59bb38b7646e", "content-length": "26", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
59692024-11-14T09:06:05.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59702024-11-14T09:06:05.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
59712024-11-14T09:06:05.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59722024-11-14T09:06:05.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59732024-11-14T09:06:05.835ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59742024-11-14T09:06:05.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "59034c1b-df41-4bda-9c44-57cc2ca034d3", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59752024-11-14T09:06:05.836ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59762024-11-14T09:06:05.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "676d1aa8-ad59-449f-9e91-a15f9cc9b238", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59772024-11-14T09:06:05.838ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59782024-11-14T09:06:05.839ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59792024-11-14T09:06:05.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 308.443656ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59802024-11-14T09:06:05.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
59812024-11-14T09:06:05.924ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59822024-11-14T09:06:05.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59832024-11-14T09:06:05.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59842024-11-14T09:06:05.926ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
59852024-11-14T09:06:05.926ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59862024-11-14T09:06:05.926ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
59872024-11-14T09:06:05.926ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 395.523555ms iteration = 10 status = {"generation":2}
59882024-11-14T09:06:05.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59892024-11-14T09:06:05.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59902024-11-14T09:06:05.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59912024-11-14T09:06:05.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922024-11-14T09:06:05.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59932024-11-14T09:06:05.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59942024-11-14T09:06:05.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59952024-11-14T09:06:05.989ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.806505ms iteration = 17 status = {}
59962024-11-14T09:06:06.002ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf90ee8-a300-4fec-a40c-def180d9d72b", "content-length": "372", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
59972024-11-14T09:06:06.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59982024-11-14T09:06:06.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59992024-11-14T09:06:06.026ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
60002024-11-14T09:06:06.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60012024-11-14T09:06:06.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "515cd0a8-8859-4526-9de3-0941099134a8", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
60022024-11-14T09:06:06.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60032024-11-14T09:06:06.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60042024-11-14T09:06:06.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60052024-11-14T09:06:06.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60062024-11-14T09:06:06.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60072024-11-14T09:06:06.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60082024-11-14T09:06:06.035ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60092024-11-14T09:06:06.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60102024-11-14T09:06:06.035ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9eb0a6e3-e572-4cdd-a736-b92adcc0b432", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
60112024-11-14T09:06:06.036ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60122024-11-14T09:06:06.037ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "39e6ba65-9b73-438f-b2c5-7791fa4977d7", "content-length": "1", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
60132024-11-14T09:06:06.038ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 506.61409ms iteration = 18 status = {}
60142024-11-14T09:06:06.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60152024-11-14T09:06:06.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60162024-11-14T09:06:06.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60172024-11-14T09:06:06.061ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b63c0c17-cba6-41f0-b260-08f191be673b", "content-length": "691", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
60182024-11-14T09:06:06.062ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60192024-11-14T09:06:06.062ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60202024-11-14T09:06:06.062ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60212024-11-14T09:06:06.063ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 532.156979ms iteration = 17 status = null
60222024-11-14T09:06:06.064ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 533.243417ms iteration = 17 status = {}
60232024-11-14T09:06:06.078ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60242024-11-14T09:06:06.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e76de778-133e-4545-a221-4ebbcf4c2d04", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60252024-11-14T09:06:06.079ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60262024-11-14T09:06:06.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6fad47e9-a4f6-4578-8d7a-67563c2455b1", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60272024-11-14T09:06:06.080ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60282024-11-14T09:06:06.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a545ff12-1f64-4580-aea7-223af1800d4e", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60292024-11-14T09:06:06.082ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60302024-11-14T09:06:06.084ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60312024-11-14T09:06:06.084ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.518942ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60322024-11-14T09:06:06.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60332024-11-14T09:06:06.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60342024-11-14T09:06:06.093ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
60352024-11-14T09:06:06.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60362024-11-14T09:06:06.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60372024-11-14T09:06:06.103ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60382024-11-14T09:06:06.103ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4a430a8-2744-4c48-9e64-c3450fef67b7", "content-length": "134", "date": "Thu, 14 Nov 2024 09:06:06 GMT"} })
60392024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60402024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
60412024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60422024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60432024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60442024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60452024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60462024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60472024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60482024-11-14T09:06:06.103ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60492024-11-14T09:06:06.104ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
60502024-11-14T09:06:06.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60512024-11-14T09:06:06.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60522024-11-14T09:06:06.106ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60532024-11-14T09:06:06.106ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e64d1c-af74-46e4-b4ac-56f3b37a8c84", "content-length": "2", "date": "Thu, 14 Nov 2024 09:06:06 GMT"} })
60542024-11-14T09:06:06.106ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60552024-11-14T09:06:06.106ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f12fa876-6763-4f64-91e5-2b8ed838bce1", "content-length": "52", "date": "Thu, 14 Nov 2024 09:06:06 GMT"} })
60562024-11-14T09:06:06.106ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
60572024-11-14T09:06:06.106ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60582024-11-14T09:06:06.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f582a912-a418-46ae-8c82-765b389f28ae", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
60592024-11-14T09:06:06.214ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
60602024-11-14T09:06:06.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60612024-11-14T09:06:06.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "77f33d69-da31-4666-be73-21854d817089", "content-length": "682", "date": "Thu, 14 Nov 2024 09:06:05 GMT"} })
60622024-11-14T09:06:06.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60632024-11-14T09:06:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60642024-11-14T09:06:06.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60652024-11-14T09:06:06.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60662024-11-14T09:06:06.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60672024-11-14T09:06:06.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60682024-11-14T09:06:06.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60692024-11-14T09:06:06.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60702024-11-14T09:06:06.230ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.127302ms iteration = 17 status = {}
60712024-11-14T09:06:06.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c9d31798-5279-489a-8fb4-98349ffdbf6d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60722024-11-14T09:06:06.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c9d31798-5279-489a-8fb4-98349ffdbf6d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60732024-11-14T09:06:06.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c9d31798-5279-489a-8fb4-98349ffdbf6d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60742024-11-14T09:06:06.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 838883d1-3df4-412e-b1c9-c45533f46d99 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60752024-11-14T09:06:06.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 838883d1-3df4-412e-b1c9-c45533f46d99 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60762024-11-14T09:06:06.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 838883d1-3df4-412e-b1c9-c45533f46d99 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60772024-11-14T09:06:07.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4596849c-4b7f-4621-807a-20f0c073c5dc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60782024-11-14T09:06:07.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4596849c-4b7f-4621-807a-20f0c073c5dc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60792024-11-14T09:06:07.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4596849c-4b7f-4621-807a-20f0c073c5dc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60802024-11-14T09:06:08.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee9559da-205f-4d0e-8f59-b8fe673d1929 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60812024-11-14T09:06:08.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee9559da-205f-4d0e-8f59-b8fe673d1929 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60822024-11-14T09:06:08.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee9559da-205f-4d0e-8f59-b8fe673d1929 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60832024-11-14T09:06:09.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aab5caa2-6f62-449e-ab19-a08aa3408bfb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60842024-11-14T09:06:09.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aab5caa2-6f62-449e-ab19-a08aa3408bfb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60852024-11-14T09:06:09.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aab5caa2-6f62-449e-ab19-a08aa3408bfb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60862024-11-14T09:06:10.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 214d6b9c-16a3-47ea-b430-43c8e2a5d115 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60872024-11-14T09:06:10.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 214d6b9c-16a3-47ea-b430-43c8e2a5d115 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60882024-11-14T09:06:10.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 214d6b9c-16a3-47ea-b430-43c8e2a5d115 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60892024-11-14T09:06:11.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dea50eb9-6344-4cdc-b721-e5bae8528c9d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60902024-11-14T09:06:11.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dea50eb9-6344-4cdc-b721-e5bae8528c9d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60912024-11-14T09:06:11.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dea50eb9-6344-4cdc-b721-e5bae8528c9d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60922024-11-14T09:06:12.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9420419f-cf02-4ea5-a4f1-0cd8c92dffe7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60932024-11-14T09:06:12.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9420419f-cf02-4ea5-a4f1-0cd8c92dffe7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60942024-11-14T09:06:12.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9420419f-cf02-4ea5-a4f1-0cd8c92dffe7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60952024-11-14T09:06:13.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4778e9fc-336e-4fe9-b01b-121bf3be5bb6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60962024-11-14T09:06:13.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4778e9fc-336e-4fe9-b01b-121bf3be5bb6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60972024-11-14T09:06:13.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4778e9fc-336e-4fe9-b01b-121bf3be5bb6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
60982024-11-14T09:06:14.048ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1514 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = dc9f7ac2-f7f0-4836-9fd2-6c0ec82d548a response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
60992024-11-14T09:06:14.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b6e2dbc-ea09-4afe-ad54-f450b9b4d27e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61002024-11-14T09:06:14.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b6e2dbc-ea09-4afe-ad54-f450b9b4d27e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61012024-11-14T09:06:14.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b6e2dbc-ea09-4afe-ad54-f450b9b4d27e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61022024-11-14T09:06:15.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
61032024-11-14T09:06:15.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61042024-11-14T09:06:15.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
61052024-11-14T09:06:15.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61062024-11-14T09:06:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61072024-11-14T09:06:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61082024-11-14T09:06:15.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61092024-11-14T09:06:15.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61102024-11-14T09:06:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61112024-11-14T09:06:15.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.723456ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61122024-11-14T09:06:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61132024-11-14T09:06:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61142024-11-14T09:06:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61152024-11-14T09:06:15.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61162024-11-14T09:06:15.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61172024-11-14T09:06:15.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61182024-11-14T09:06:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
61192024-11-14T09:06:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61202024-11-14T09:06:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61212024-11-14T09:06:15.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
61222024-11-14T09:06:15.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.455876ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
61232024-11-14T09:06:15.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 818e7759-9822-44a7-bc32-1b97fc17e948 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61242024-11-14T09:06:15.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 818e7759-9822-44a7-bc32-1b97fc17e948 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61252024-11-14T09:06:15.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 818e7759-9822-44a7-bc32-1b97fc17e948 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61262024-11-14T09:06:16.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c03ce0a5-777b-451e-8a96-233578f2c94b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61272024-11-14T09:06:16.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c03ce0a5-777b-451e-8a96-233578f2c94b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61282024-11-14T09:06:16.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c03ce0a5-777b-451e-8a96-233578f2c94b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61292024-11-14T09:06:17.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e5f14cb-a2cb-4252-b04c-12a1c99d8962 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61302024-11-14T09:06:17.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e5f14cb-a2cb-4252-b04c-12a1c99d8962 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61312024-11-14T09:06:17.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e5f14cb-a2cb-4252-b04c-12a1c99d8962 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61322024-11-14T09:06:18.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9cc3574f-76ca-4269-96e2-7d8569b237eb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61332024-11-14T09:06:18.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9cc3574f-76ca-4269-96e2-7d8569b237eb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61342024-11-14T09:06:18.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9cc3574f-76ca-4269-96e2-7d8569b237eb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61352024-11-14T09:06:19.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6afcc5a2-4a95-4f91-b80c-3e992e8bb885 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61362024-11-14T09:06:19.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6afcc5a2-4a95-4f91-b80c-3e992e8bb885 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61372024-11-14T09:06:19.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6afcc5a2-4a95-4f91-b80c-3e992e8bb885 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61382024-11-14T09:06:20.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11edfe79-94a1-4b48-8e17-31ceb8c74b5a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61392024-11-14T09:06:20.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11edfe79-94a1-4b48-8e17-31ceb8c74b5a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61402024-11-14T09:06:20.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11edfe79-94a1-4b48-8e17-31ceb8c74b5a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61412024-11-14T09:06:21.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 631bca79-72e5-4ede-8cb0-6aa8ddc017ca roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61422024-11-14T09:06:21.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 631bca79-72e5-4ede-8cb0-6aa8ddc017ca resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61432024-11-14T09:06:21.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 631bca79-72e5-4ede-8cb0-6aa8ddc017ca response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61442024-11-14T09:06:22.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e3921363-c3a4-4333-962e-6432362dc126 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61452024-11-14T09:06:22.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e3921363-c3a4-4333-962e-6432362dc126 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61462024-11-14T09:06:22.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e3921363-c3a4-4333-962e-6432362dc126 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61472024-11-14T09:06:23.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4bc6bb69-b0e8-4a48-8476-1ab94dd3a248 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61482024-11-14T09:06:23.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4bc6bb69-b0e8-4a48-8476-1ab94dd3a248 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61492024-11-14T09:06:23.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4bc6bb69-b0e8-4a48-8476-1ab94dd3a248 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61502024-11-14T09:06:24.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92818aa1-f191-4563-a234-3ddd7e893b8d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61512024-11-14T09:06:24.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92818aa1-f191-4563-a234-3ddd7e893b8d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61522024-11-14T09:06:24.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92818aa1-f191-4563-a234-3ddd7e893b8d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61532024-11-14T09:06:25.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
61542024-11-14T09:06:25.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61552024-11-14T09:06:25.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
61562024-11-14T09:06:25.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61572024-11-14T09:06:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61582024-11-14T09:06:25.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61592024-11-14T09:06:25.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61602024-11-14T09:06:25.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61612024-11-14T09:06:25.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61622024-11-14T09:06:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61632024-11-14T09:06:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61642024-11-14T09:06:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61652024-11-14T09:06:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61662024-11-14T09:06:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61672024-11-14T09:06:25.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61682024-11-14T09:06:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
61692024-11-14T09:06:25.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61702024-11-14T09:06:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61712024-11-14T09:06:25.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
61722024-11-14T09:06:25.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.140633ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
61732024-11-14T09:06:25.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.285011ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61742024-11-14T09:06:25.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e55e8ecb-0743-4f93-9672-55971e741c33 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61752024-11-14T09:06:25.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e55e8ecb-0743-4f93-9672-55971e741c33 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61762024-11-14T09:06:25.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e55e8ecb-0743-4f93-9672-55971e741c33 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61772024-11-14T09:06:26.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1bafbe0c-05e8-4dd8-810f-3e4cb47dfdd7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61782024-11-14T09:06:26.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1bafbe0c-05e8-4dd8-810f-3e4cb47dfdd7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61792024-11-14T09:06:26.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1bafbe0c-05e8-4dd8-810f-3e4cb47dfdd7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61802024-11-14T09:06:27.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ef6d198-9459-4b55-bd03-78aa04dd26c2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61812024-11-14T09:06:27.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ef6d198-9459-4b55-bd03-78aa04dd26c2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61822024-11-14T09:06:27.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ef6d198-9459-4b55-bd03-78aa04dd26c2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61832024-11-14T09:06:28.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e236dd43-9051-47f8-b837-fb7aafc5b7a4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61842024-11-14T09:06:28.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e236dd43-9051-47f8-b837-fb7aafc5b7a4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61852024-11-14T09:06:28.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e236dd43-9051-47f8-b837-fb7aafc5b7a4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61862024-11-14T09:06:29.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1331 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 34923972-4162-408d-a85b-326a627e3565 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
61872024-11-14T09:06:29.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 321e54c8-cda1-4d2f-b705-0221ffee08d4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61882024-11-14T09:06:29.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 321e54c8-cda1-4d2f-b705-0221ffee08d4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61892024-11-14T09:06:29.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 321e54c8-cda1-4d2f-b705-0221ffee08d4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61902024-11-14T09:06:31.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73832ec4-5262-47db-a192-f953b08e73a9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61912024-11-14T09:06:31.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73832ec4-5262-47db-a192-f953b08e73a9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61922024-11-14T09:06:31.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73832ec4-5262-47db-a192-f953b08e73a9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61932024-11-14T09:06:32.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c0664e68-45b9-47f6-9aaf-bfba3d9f935c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61942024-11-14T09:06:32.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c0664e68-45b9-47f6-9aaf-bfba3d9f935c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61952024-11-14T09:06:32.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c0664e68-45b9-47f6-9aaf-bfba3d9f935c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61962024-11-14T09:06:33.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5dc6443-efb4-43e6-9c3b-c4d98f0dfafa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61972024-11-14T09:06:33.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5dc6443-efb4-43e6-9c3b-c4d98f0dfafa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61982024-11-14T09:06:33.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5dc6443-efb4-43e6-9c3b-c4d98f0dfafa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
61992024-11-14T09:06:34.039ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:51506
62002024-11-14T09:06:34.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d3327a3e-1a4e-4648-8668-f93f07830e6c roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
62012024-11-14T09:06:34.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d3327a3e-1a4e-4648-8668-f93f07830e6c resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
62022024-11-14T09:06:34.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d3327a3e-1a4e-4648-8668-f93f07830e6c response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
62032024-11-14T09:06:34.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 1a782d23-0c51-4272-b033-64db594f5a1f roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
62042024-11-14T09:06:34.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 1a782d23-0c51-4272-b033-64db594f5a1f resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
62052024-11-14T09:06:34.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 1a782d23-0c51-4272-b033-64db594f5a1f response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
62062024-11-14T09:06:34.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4f7afc20-00dd-46db-a775-246859e11a95 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62072024-11-14T09:06:34.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4f7afc20-00dd-46db-a775-246859e11a95 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62082024-11-14T09:06:34.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4f7afc20-00dd-46db-a775-246859e11a95 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62092024-11-14T09:06:35.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 272ba48e-33dc-4167-9d9f-f28321e61652 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62102024-11-14T09:06:35.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 272ba48e-33dc-4167-9d9f-f28321e61652 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62112024-11-14T09:06:35.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 272ba48e-33dc-4167-9d9f-f28321e61652 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
62122024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
62132024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62142024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
62152024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62162024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
62172024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
62182024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62192024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
62202024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62212024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
62222024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62232024-11-14T09:06:35.531ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62242024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62252024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
62262024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
62272024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62282024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
62292024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62302024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
62312024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62322024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
62332024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62342024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62352024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
62362024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62372024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
62382024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62392024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
62402024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62412024-11-14T09:06:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
62422024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62432024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
62442024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62452024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
62462024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62472024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62482024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62492024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62502024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62512024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62522024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62532024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62542024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62552024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62562024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62572024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62582024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62592024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62602024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62612024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62622024-11-14T09:06:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62632024-11-14T09:06:35.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62642024-11-14T09:06:35.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 321530668 } })
62652024-11-14T09:06:35.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.291383ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62662024-11-14T09:06:35.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
62672024-11-14T09:06:35.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62682024-11-14T09:06:35.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692024-11-14T09:06:35.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62702024-11-14T09:06:35.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62712024-11-14T09:06:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62722024-11-14T09:06:35.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732024-11-14T09:06:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62742024-11-14T09:06:35.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62752024-11-14T09:06:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62762024-11-14T09:06:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62772024-11-14T09:06:35.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62782024-11-14T09:06:35.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-11-14T09:06:35.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-11-14T09:06:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62812024-11-14T09:06:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62822024-11-14T09:06:35.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62832024-11-14T09:06:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62842024-11-14T09:06:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62852024-11-14T09:06:35.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62862024-11-14T09:06:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62872024-11-14T09:06:35.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 330495202 } })
62882024-11-14T09:06:35.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
62892024-11-14T09:06:35.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62902024-11-14T09:06:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62912024-11-14T09:06:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62922024-11-14T09:06:35.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62932024-11-14T09:06:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62942024-11-14T09:06:35.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62952024-11-14T09:06:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62962024-11-14T09:06:35.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 340439071 } })
62972024-11-14T09:06:35.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
62982024-11-14T09:06:35.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992024-11-14T09:06:35.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63002024-11-14T09:06:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63012024-11-14T09:06:35.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63022024-11-14T09:06:35.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63032024-11-14T09:06:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63042024-11-14T09:06:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63052024-11-14T09:06:35.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63062024-11-14T09:06:35.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63072024-11-14T09:06:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63082024-11-14T09:06:35.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092024-11-14T09:06:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63102024-11-14T09:06:35.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63112024-11-14T09:06:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63122024-11-14T09:06:35.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.623937ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
63132024-11-14T09:06:35.587ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63142024-11-14T09:06:35.587ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63152024-11-14T09:06:35.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63162024-11-14T09:06:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63172024-11-14T09:06:35.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63182024-11-14T09:06:35.591ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63192024-11-14T09:06:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63202024-11-14T09:06:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63212024-11-14T09:06:35.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222024-11-14T09:06:35.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.67714ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
63232024-11-14T09:06:35.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63242024-11-14T09:06:35.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63252024-11-14T09:06:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63262024-11-14T09:06:35.594ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63272024-11-14T09:06:35.594ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63282024-11-14T09:06:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63292024-11-14T09:06:35.595ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cdfabed-6fee-46a3-8728-c0b8fac755c6", "content-length": "26", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
63302024-11-14T09:06:35.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63312024-11-14T09:06:35.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 64.018789ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63322024-11-14T09:06:35.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63332024-11-14T09:06:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
63342024-11-14T09:06:35.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63352024-11-14T09:06:35.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63362024-11-14T09:06:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63372024-11-14T09:06:35.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
63382024-11-14T09:06:35.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63392024-11-14T09:06:35.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63402024-11-14T09:06:35.603ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.340336ms iteration = 18 status = 0
63412024-11-14T09:06:35.604ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63422024-11-14T09:06:35.604ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63432024-11-14T09:06:35.605ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "988074fe-7634-4b73-b3d5-07181afdeb26", "content-length": "26", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
63442024-11-14T09:06:35.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63452024-11-14T09:06:35.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.604753ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63462024-11-14T09:06:35.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63472024-11-14T09:06:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63482024-11-14T09:06:35.608ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63492024-11-14T09:06:35.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63502024-11-14T09:06:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63512024-11-14T09:06:35.611ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63522024-11-14T09:06:35.611ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.075467ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63532024-11-14T09:06:35.615ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
63542024-11-14T09:06:35.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.4431ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
63552024-11-14T09:06:35.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
63562024-11-14T09:06:35.622ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63572024-11-14T09:06:35.622ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "316ac9cd-e7ef-4673-9aee-2714b039a720", "content-length": "26", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
63582024-11-14T09:06:35.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63592024-11-14T09:06:35.623ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.209615ms iteration = 21 status = {"physical_disks_added":0}
63602024-11-14T09:06:35.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
63612024-11-14T09:06:35.628ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63622024-11-14T09:06:35.628ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63632024-11-14T09:06:35.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63642024-11-14T09:06:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63652024-11-14T09:06:35.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.058544ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63662024-11-14T09:06:35.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.610686ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63672024-11-14T09:06:35.673ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63682024-11-14T09:06:35.673ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63692024-11-14T09:06:35.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.85226ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63702024-11-14T09:06:35.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63712024-11-14T09:06:35.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63722024-11-14T09:06:35.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63732024-11-14T09:06:35.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63742024-11-14T09:06:35.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63752024-11-14T09:06:35.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63762024-11-14T09:06:35.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63772024-11-14T09:06:35.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63782024-11-14T09:06:35.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63792024-11-14T09:06:35.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63802024-11-14T09:06:35.706ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63812024-11-14T09:06:35.707ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b025279d-ab83-4e4c-a4c0-93c2c3fb48b2", "content-length": "1", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
63822024-11-14T09:06:35.708ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63832024-11-14T09:06:35.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63842024-11-14T09:06:35.711ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.471853ms iteration = 18 status = null
63852024-11-14T09:06:35.729ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 197.371631ms iteration = 18 status = {}
63862024-11-14T09:06:35.744ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63872024-11-14T09:06:35.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63882024-11-14T09:06:35.745ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "446a4404-7548-40e0-b9a8-adec5a16015a", "content-length": "372", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
63892024-11-14T09:06:35.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63902024-11-14T09:06:35.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63912024-11-14T09:06:35.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63922024-11-14T09:06:35.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cd1fdb7-9318-44ab-a6f2-ebb6f948041b", "content-length": "691", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
63932024-11-14T09:06:35.782ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63942024-11-14T09:06:35.782ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63952024-11-14T09:06:35.782ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63962024-11-14T09:06:35.783ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 251.285047ms iteration = 18 status = {}
63972024-11-14T09:06:35.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63982024-11-14T09:06:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63992024-11-14T09:06:35.820ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64002024-11-14T09:06:35.820ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64012024-11-14T09:06:35.820ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "79621533-c298-46c8-9bf7-4daca3cf61a8", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64022024-11-14T09:06:35.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64032024-11-14T09:06:35.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64042024-11-14T09:06:35.821ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
64052024-11-14T09:06:35.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64062024-11-14T09:06:35.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64072024-11-14T09:06:35.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64082024-11-14T09:06:35.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64092024-11-14T09:06:35.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64102024-11-14T09:06:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64112024-11-14T09:06:35.828ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64122024-11-14T09:06:35.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64132024-11-14T09:06:35.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fb499154-5d8e-4e6d-90a6-cc12b62e78cd", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64142024-11-14T09:06:35.830ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64152024-11-14T09:06:35.830ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 298.912933ms iteration = 19 status = {}
64162024-11-14T09:06:35.830ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec7dee90-bf18-46cd-8b64-c782f4116bab", "content-length": "134", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64172024-11-14T09:06:35.830ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64182024-11-14T09:06:35.830ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
64192024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64202024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64212024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64222024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64232024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64242024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64252024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64262024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64272024-11-14T09:06:35.831ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
64282024-11-14T09:06:35.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64292024-11-14T09:06:35.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64302024-11-14T09:06:35.833ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64312024-11-14T09:06:35.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "34d09183-5416-4c50-89b9-1fbd4c825698", "content-length": "2", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64322024-11-14T09:06:35.833ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64332024-11-14T09:06:35.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9732dbc9-3783-4b00-8713-19999392a26c", "content-length": "52", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64342024-11-14T09:06:35.833ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
64352024-11-14T09:06:35.833ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64362024-11-14T09:06:35.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8c10e274-67d7-4594-a662-2f9c709c215b", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64372024-11-14T09:06:35.928ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
64382024-11-14T09:06:35.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64392024-11-14T09:06:35.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f222fe3f-3239-4d8a-a17f-eef233b08875", "content-length": "682", "date": "Thu, 14 Nov 2024 09:06:35 GMT"} })
64402024-11-14T09:06:35.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64412024-11-14T09:06:35.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64422024-11-14T09:06:35.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64432024-11-14T09:06:35.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64442024-11-14T09:06:35.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64452024-11-14T09:06:35.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64462024-11-14T09:06:35.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64472024-11-14T09:06:35.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64482024-11-14T09:06:35.945ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 413.964451ms iteration = 18 status = {}
64492024-11-14T09:06:36.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e80e92c-050f-4745-909d-75ed7d07d296 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64502024-11-14T09:06:36.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e80e92c-050f-4745-909d-75ed7d07d296 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64512024-11-14T09:06:36.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e80e92c-050f-4745-909d-75ed7d07d296 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64522024-11-14T09:06:36.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = c355b7aa-9dfc-47f8-a104-9a3ecbe9b488 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64532024-11-14T09:06:36.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = c355b7aa-9dfc-47f8-a104-9a3ecbe9b488 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64542024-11-14T09:06:36.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = c355b7aa-9dfc-47f8-a104-9a3ecbe9b488 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64552024-11-14T09:06:37.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 767474a9-13e3-46df-bcc3-73fa8d5bd212 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64562024-11-14T09:06:37.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 767474a9-13e3-46df-bcc3-73fa8d5bd212 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64572024-11-14T09:06:37.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 767474a9-13e3-46df-bcc3-73fa8d5bd212 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64582024-11-14T09:06:38.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2394b0c6-95bc-4111-9a3c-34dd2e9da863 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64592024-11-14T09:06:38.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2394b0c6-95bc-4111-9a3c-34dd2e9da863 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64602024-11-14T09:06:38.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2394b0c6-95bc-4111-9a3c-34dd2e9da863 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64612024-11-14T09:06:39.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 166346b2-a3c6-44cc-af91-2dcb273eeda6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64622024-11-14T09:06:39.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 166346b2-a3c6-44cc-af91-2dcb273eeda6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64632024-11-14T09:06:39.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 166346b2-a3c6-44cc-af91-2dcb273eeda6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64642024-11-14T09:06:40.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1144ba23-b9ac-41d3-a5fe-b3881f839a6f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64652024-11-14T09:06:40.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1144ba23-b9ac-41d3-a5fe-b3881f839a6f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64662024-11-14T09:06:40.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1144ba23-b9ac-41d3-a5fe-b3881f839a6f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64672024-11-14T09:06:41.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 924d63c9-8691-4657-8e89-4beaf52e55bf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64682024-11-14T09:06:41.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 924d63c9-8691-4657-8e89-4beaf52e55bf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64692024-11-14T09:06:41.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 924d63c9-8691-4657-8e89-4beaf52e55bf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64702024-11-14T09:06:42.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44cb22c3-95fd-44ca-b20b-11262a3f6213 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64712024-11-14T09:06:42.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44cb22c3-95fd-44ca-b20b-11262a3f6213 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64722024-11-14T09:06:42.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44cb22c3-95fd-44ca-b20b-11262a3f6213 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64732024-11-14T09:06:43.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3473b3ae-11f8-4023-9242-244515cc9fc2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64742024-11-14T09:06:43.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3473b3ae-11f8-4023-9242-244515cc9fc2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64752024-11-14T09:06:43.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3473b3ae-11f8-4023-9242-244515cc9fc2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64762024-11-14T09:06:44.049ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1474 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = dae91bf3-e8d6-46ae-aaa1-c8a83a4df0c2 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
64772024-11-14T09:06:44.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 801b1582-bda1-4eef-a6e5-2cad9d9bf7f2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64782024-11-14T09:06:44.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 801b1582-bda1-4eef-a6e5-2cad9d9bf7f2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64792024-11-14T09:06:44.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 801b1582-bda1-4eef-a6e5-2cad9d9bf7f2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64802024-11-14T09:06:45.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d0ebff7-0c3b-4716-b178-c5ead8f3b31e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64812024-11-14T09:06:45.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d0ebff7-0c3b-4716-b178-c5ead8f3b31e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64822024-11-14T09:06:45.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d0ebff7-0c3b-4716-b178-c5ead8f3b31e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
64832024-11-14T09:06:45.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
64842024-11-14T09:06:45.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64852024-11-14T09:06:45.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
64862024-11-14T09:06:45.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64872024-11-14T09:06:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64882024-11-14T09:06:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64892024-11-14T09:06:45.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902024-11-14T09:06:45.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64912024-11-14T09:06:45.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64922024-11-14T09:06:45.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64932024-11-14T09:06:45.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64942024-11-14T09:06:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64952024-11-14T09:06:45.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64962024-11-14T09:06:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
64972024-11-14T09:06:45.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64982024-11-14T09:06:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64992024-11-14T09:06:45.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
65002024-11-14T09:06:45.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.235662ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
65012024-11-14T09:06:45.566ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65022024-11-14T09:06:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65032024-11-14T09:06:45.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.458649ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65042024-11-14T09:06:46.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21fb61fd-3cfb-4a17-b902-0c995a7c91f9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65052024-11-14T09:06:46.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21fb61fd-3cfb-4a17-b902-0c995a7c91f9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65062024-11-14T09:06:46.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21fb61fd-3cfb-4a17-b902-0c995a7c91f9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65072024-11-14T09:06:47.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62be37ba-f565-4599-8366-493319a7a7e3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65082024-11-14T09:06:47.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62be37ba-f565-4599-8366-493319a7a7e3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65092024-11-14T09:06:47.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62be37ba-f565-4599-8366-493319a7a7e3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65102024-11-14T09:06:48.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7e81d767-7922-4f24-bc34-80ee77e4350d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65112024-11-14T09:06:48.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7e81d767-7922-4f24-bc34-80ee77e4350d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65122024-11-14T09:06:48.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7e81d767-7922-4f24-bc34-80ee77e4350d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65132024-11-14T09:06:49.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c21b14a-f580-450d-8b8d-53cae056d3d9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65142024-11-14T09:06:49.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c21b14a-f580-450d-8b8d-53cae056d3d9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65152024-11-14T09:06:49.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c21b14a-f580-450d-8b8d-53cae056d3d9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65162024-11-14T09:06:50.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 320c587f-8ed2-484f-a021-66ba09c6453e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65172024-11-14T09:06:50.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 320c587f-8ed2-484f-a021-66ba09c6453e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65182024-11-14T09:06:50.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 320c587f-8ed2-484f-a021-66ba09c6453e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65192024-11-14T09:06:51.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 367d82d2-2a40-4a13-9403-91a016d6d59e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65202024-11-14T09:06:51.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 367d82d2-2a40-4a13-9403-91a016d6d59e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65212024-11-14T09:06:51.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 367d82d2-2a40-4a13-9403-91a016d6d59e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65222024-11-14T09:06:52.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9605c09a-c44f-4edd-a673-84db2f20cba3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65232024-11-14T09:06:52.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9605c09a-c44f-4edd-a673-84db2f20cba3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65242024-11-14T09:06:52.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9605c09a-c44f-4edd-a673-84db2f20cba3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65252024-11-14T09:06:53.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aef031ff-5d69-42ba-bbc1-78b2f64594d2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65262024-11-14T09:06:53.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aef031ff-5d69-42ba-bbc1-78b2f64594d2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65272024-11-14T09:06:53.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aef031ff-5d69-42ba-bbc1-78b2f64594d2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65282024-11-14T09:06:54.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 890536af-468c-48cb-9c29-a7e30ab75449 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65292024-11-14T09:06:54.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 890536af-468c-48cb-9c29-a7e30ab75449 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65302024-11-14T09:06:54.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 890536af-468c-48cb-9c29-a7e30ab75449 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65312024-11-14T09:06:55.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
65322024-11-14T09:06:55.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
65332024-11-14T09:06:55.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65342024-11-14T09:06:55.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65352024-11-14T09:06:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65362024-11-14T09:06:55.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65372024-11-14T09:06:55.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65382024-11-14T09:06:55.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65392024-11-14T09:06:55.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65402024-11-14T09:06:55.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.428572ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65412024-11-14T09:06:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65422024-11-14T09:06:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65432024-11-14T09:06:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65442024-11-14T09:06:55.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65452024-11-14T09:06:55.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65462024-11-14T09:06:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65472024-11-14T09:06:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
65482024-11-14T09:06:55.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65492024-11-14T09:06:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65502024-11-14T09:06:55.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
65512024-11-14T09:06:55.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.588753ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
65522024-11-14T09:06:55.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4c73f32-3a96-4815-8d19-7799e619d323 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65532024-11-14T09:06:55.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4c73f32-3a96-4815-8d19-7799e619d323 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65542024-11-14T09:06:55.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4c73f32-3a96-4815-8d19-7799e619d323 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65552024-11-14T09:06:56.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f956db8d-f3c8-4389-85a0-aeadc9f6bfb1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65562024-11-14T09:06:56.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f956db8d-f3c8-4389-85a0-aeadc9f6bfb1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65572024-11-14T09:06:56.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f956db8d-f3c8-4389-85a0-aeadc9f6bfb1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65582024-11-14T09:06:57.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5419c855-46ed-4b7e-a946-709eb4215b23 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65592024-11-14T09:06:57.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5419c855-46ed-4b7e-a946-709eb4215b23 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65602024-11-14T09:06:57.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5419c855-46ed-4b7e-a946-709eb4215b23 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65612024-11-14T09:06:58.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0680b9e-7509-4dbb-864b-4811522b66b6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65622024-11-14T09:06:58.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0680b9e-7509-4dbb-864b-4811522b66b6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65632024-11-14T09:06:58.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0680b9e-7509-4dbb-864b-4811522b66b6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65642024-11-14T09:06:59.047ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = efd5e149-4815-4595-a959-8a48deae591f response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
65652024-11-14T09:06:59.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7c3367c5-e64d-4a25-a1cc-2d42f9d3488c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65662024-11-14T09:06:59.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7c3367c5-e64d-4a25-a1cc-2d42f9d3488c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65672024-11-14T09:06:59.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7c3367c5-e64d-4a25-a1cc-2d42f9d3488c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65682024-11-14T09:07:00.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d58a6541-0085-4503-b3a8-9deb462b89a6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65692024-11-14T09:07:00.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d58a6541-0085-4503-b3a8-9deb462b89a6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65702024-11-14T09:07:00.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d58a6541-0085-4503-b3a8-9deb462b89a6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65712024-11-14T09:07:01.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68bfe77f-40ca-45cb-acb5-6668200e472b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65722024-11-14T09:07:01.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68bfe77f-40ca-45cb-acb5-6668200e472b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65732024-11-14T09:07:01.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 68bfe77f-40ca-45cb-acb5-6668200e472b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65742024-11-14T09:07:02.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98a45914-0c8e-4ed6-a740-538a15ef860c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65752024-11-14T09:07:02.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98a45914-0c8e-4ed6-a740-538a15ef860c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65762024-11-14T09:07:02.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 98a45914-0c8e-4ed6-a740-538a15ef860c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65772024-11-14T09:07:03.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 37c2b0a6-6ac5-4b1c-8f3d-f268b4ebdac6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65782024-11-14T09:07:03.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 37c2b0a6-6ac5-4b1c-8f3d-f268b4ebdac6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65792024-11-14T09:07:03.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 37c2b0a6-6ac5-4b1c-8f3d-f268b4ebdac6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65802024-11-14T09:07:04.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21f4fcb3-921e-48e4-88d5-045502b704fb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65812024-11-14T09:07:04.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21f4fcb3-921e-48e4-88d5-045502b704fb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65822024-11-14T09:07:04.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21f4fcb3-921e-48e4-88d5-045502b704fb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
65832024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
65842024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65852024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
65862024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
65872024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65882024-11-14T09:07:05.531ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:57:05.531367668 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
65892024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
65902024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
65912024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
65922024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65932024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65942024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
65952024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
65962024-11-14T09:07:05.531ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
65972024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65982024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.25\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
65992024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
66002024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
66012024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
66022024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66032024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
66042024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66052024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66062024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
66072024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66082024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
66092024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
66102024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66112024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
66122024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66132024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
66142024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
66152024-11-14T09:07:05.531ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66162024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66172024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
66182024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66192024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66202024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66212024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
66222024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
66232024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
66242024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66252024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66262024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
66272024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
66282024-11-14T09:07:05.531ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66292024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66302024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66312024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
66322024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
66332024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66342024-11-14T09:07:05.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66352024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66362024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66372024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66382024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66392024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66402024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66412024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66422024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66432024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66442024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66452024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66462024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66472024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66482024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
66492024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66502024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
66512024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
66522024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66532024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66542024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66552024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
66562024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
66572024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66582024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66592024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66602024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
66612024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66622024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66632024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66642024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66652024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66662024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66672024-11-14T09:07:05.532ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 318790164 } })
66682024-11-14T09:07:05.532ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 318827335 } })
66692024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66702024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66712024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
66722024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66732024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
66742024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66752024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66762024-11-14T09:07:05.532ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66772024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66782024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66792024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
66802024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.796879ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
66812024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66822024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66832024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
66842024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.760789ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
66852024-11-14T09:07:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66862024-11-14T09:07:05.535ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66872024-11-14T09:07:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66882024-11-14T09:07:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66892024-11-14T09:07:05.537ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.417297ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66902024-11-14T09:07:05.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66912024-11-14T09:07:05.537ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:57:05.531367668 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
66922024-11-14T09:07:05.537ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.111318ms iteration = 10 status = {"expiration":"2024-11-14T08:57:05.531367668Z","pruned":[]}
66932024-11-14T09:07:05.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66942024-11-14T09:07:05.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66952024-11-14T09:07:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66962024-11-14T09:07:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66972024-11-14T09:07:05.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66982024-11-14T09:07:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992024-11-14T09:07:05.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67002024-11-14T09:07:05.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 328850065 } })
67012024-11-14T09:07:05.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
67022024-11-14T09:07:05.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67032024-11-14T09:07:05.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042024-11-14T09:07:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67052024-11-14T09:07:05.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67062024-11-14T09:07:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67072024-11-14T09:07:05.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67082024-11-14T09:07:05.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67092024-11-14T09:07:05.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67102024-11-14T09:07:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67112024-11-14T09:07:05.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67122024-11-14T09:07:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67132024-11-14T09:07:05.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67142024-11-14T09:07:05.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67152024-11-14T09:07:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67162024-11-14T09:07:05.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 338641673 } })
67172024-11-14T09:07:05.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
67182024-11-14T09:07:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67192024-11-14T09:07:05.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67202024-11-14T09:07:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67212024-11-14T09:07:05.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67222024-11-14T09:07:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67232024-11-14T09:07:05.570ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 37.635744ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
67242024-11-14T09:07:05.572ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
67252024-11-14T09:07:05.572ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
67262024-11-14T09:07:05.572ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 39.660827ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
67272024-11-14T09:07:05.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67282024-11-14T09:07:05.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67292024-11-14T09:07:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67302024-11-14T09:07:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67312024-11-14T09:07:05.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67322024-11-14T09:07:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67332024-11-14T09:07:05.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67342024-11-14T09:07:05.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352024-11-14T09:07:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67362024-11-14T09:07:05.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 366792955 } })
67372024-11-14T09:07:05.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
67382024-11-14T09:07:05.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67392024-11-14T09:07:05.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67402024-11-14T09:07:05.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67412024-11-14T09:07:05.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67422024-11-14T09:07:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67432024-11-14T09:07:05.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67442024-11-14T09:07:05.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67452024-11-14T09:07:05.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67462024-11-14T09:07:05.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67472024-11-14T09:07:05.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67482024-11-14T09:07:05.596ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67492024-11-14T09:07:05.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67502024-11-14T09:07:05.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67512024-11-14T09:07:05.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67522024-11-14T09:07:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67532024-11-14T09:07:05.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67542024-11-14T09:07:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67552024-11-14T09:07:05.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67562024-11-14T09:07:05.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67572024-11-14T09:07:05.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67582024-11-14T09:07:05.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67592024-11-14T09:07:05.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.781838ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
67602024-11-14T09:07:05.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67612024-11-14T09:07:05.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67622024-11-14T09:07:05.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
67632024-11-14T09:07:05.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67642024-11-14T09:07:05.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67652024-11-14T09:07:05.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67662024-11-14T09:07:05.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67672024-11-14T09:07:05.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67682024-11-14T09:07:05.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67692024-11-14T09:07:05.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67702024-11-14T09:07:05.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.741835ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67712024-11-14T09:07:05.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67722024-11-14T09:07:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67732024-11-14T09:07:05.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67742024-11-14T09:07:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67752024-11-14T09:07:05.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67762024-11-14T09:07:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67772024-11-14T09:07:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67782024-11-14T09:07:05.637ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67792024-11-14T09:07:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67802024-11-14T09:07:05.637ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67812024-11-14T09:07:05.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67822024-11-14T09:07:05.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67832024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
67842024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67852024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67862024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67872024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67882024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67892024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67902024-11-14T09:07:05.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 109.567691ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
67912024-11-14T09:07:05.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67922024-11-14T09:07:05.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67932024-11-14T09:07:05.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67942024-11-14T09:07:05.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-11-14T09:07:05.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67962024-11-14T09:07:05.647ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67972024-11-14T09:07:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67982024-11-14T09:07:05.648ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67992024-11-14T09:07:05.648ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68002024-11-14T09:07:05.648ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68012024-11-14T09:07:05.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68022024-11-14T09:07:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68032024-11-14T09:07:05.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.65167ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68042024-11-14T09:07:05.655ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 123.84759ms iteration = 5 status = {"nsuccess":5}
68052024-11-14T09:07:05.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68062024-11-14T09:07:05.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68072024-11-14T09:07:05.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
68082024-11-14T09:07:05.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.909105ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
68092024-11-14T09:07:05.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68102024-11-14T09:07:05.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68112024-11-14T09:07:05.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68122024-11-14T09:07:05.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68132024-11-14T09:07:05.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68142024-11-14T09:07:05.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
68152024-11-14T09:07:05.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68162024-11-14T09:07:05.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68172024-11-14T09:07:05.677ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.24663ms iteration = 19 status = 0
68182024-11-14T09:07:05.685ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68192024-11-14T09:07:05.689ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68202024-11-14T09:07:05.689ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68212024-11-14T09:07:05.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68222024-11-14T09:07:05.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68232024-11-14T09:07:05.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68242024-11-14T09:07:05.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68252024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68262024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68272024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68282024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68292024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68302024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68312024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68322024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68332024-11-14T09:07:05.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68342024-11-14T09:07:05.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68352024-11-14T09:07:05.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68362024-11-14T09:07:05.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68372024-11-14T09:07:05.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68382024-11-14T09:07:05.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68392024-11-14T09:07:05.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68402024-11-14T09:07:05.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68412024-11-14T09:07:05.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.371806ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68422024-11-14T09:07:05.701ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68432024-11-14T09:07:05.701ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68442024-11-14T09:07:05.701ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 169.87855ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68452024-11-14T09:07:05.701ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68462024-11-14T09:07:05.701ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
68472024-11-14T09:07:05.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68482024-11-14T09:07:05.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68492024-11-14T09:07:05.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
68502024-11-14T09:07:05.703ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68512024-11-14T09:07:05.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68522024-11-14T09:07:05.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 171.505325ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68532024-11-14T09:07:05.704ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6427fcd0-6cc4-44f0-8120-c27104667ffb", "content-length": "26", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
68542024-11-14T09:07:05.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68552024-11-14T09:07:05.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68562024-11-14T09:07:05.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68572024-11-14T09:07:05.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68582024-11-14T09:07:05.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68592024-11-14T09:07:05.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68602024-11-14T09:07:05.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68612024-11-14T09:07:05.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68622024-11-14T09:07:05.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
68632024-11-14T09:07:05.709ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68642024-11-14T09:07:05.709ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6569eb6-3821-4617-b974-7584578b5dcc", "content-length": "26", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
68652024-11-14T09:07:05.709ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68662024-11-14T09:07:05.710ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68672024-11-14T09:07:05.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 178.335665ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68682024-11-14T09:07:05.711ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68692024-11-14T09:07:05.714ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
68702024-11-14T09:07:05.714ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68712024-11-14T09:07:05.714ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
68722024-11-14T09:07:05.714ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 182.517452ms iteration = 11 status = {"generation":2}
68732024-11-14T09:07:05.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68742024-11-14T09:07:05.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68752024-11-14T09:07:05.736ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68762024-11-14T09:07:05.736ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68772024-11-14T09:07:05.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 204.81493ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68782024-11-14T09:07:05.740ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
68792024-11-14T09:07:05.748ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68802024-11-14T09:07:05.748ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68812024-11-14T09:07:05.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68822024-11-14T09:07:05.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68832024-11-14T09:07:05.752ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
68842024-11-14T09:07:05.752ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 221.248835ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68852024-11-14T09:07:05.780ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 248.801037ms iteration = 22 status = {"physical_disks_added":0}
68862024-11-14T09:07:05.780ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
68872024-11-14T09:07:05.780ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 248.918059ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68882024-11-14T09:07:05.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b5f25c47-8c98-434f-ac00-9bd3cb0d440f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
68892024-11-14T09:07:05.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b5f25c47-8c98-434f-ac00-9bd3cb0d440f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
68902024-11-14T09:07:05.868ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
68912024-11-14T09:07:05.868ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1a760d1e-a925-4b1b-b4bd-cee6e9e32566", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68922024-11-14T09:07:05.868ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68932024-11-14T09:07:05.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e79fe2fc-d404-457b-ac01-1a3720d31b97", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68942024-11-14T09:07:05.871ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68952024-11-14T09:07:05.872ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68962024-11-14T09:07:05.873ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68972024-11-14T09:07:05.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 341.349674ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
68982024-11-14T09:07:05.873ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "84bd88bb-6c49-4bb8-bc80-ff637bcf5611", "content-length": "1", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
68992024-11-14T09:07:05.874ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69002024-11-14T09:07:05.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69012024-11-14T09:07:05.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
69022024-11-14T09:07:05.875ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69032024-11-14T09:07:05.875ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d62462a0-2d85-40bb-8280-1992bdd6956f", "content-length": "26", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69042024-11-14T09:07:05.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69052024-11-14T09:07:05.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
69062024-11-14T09:07:05.879ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69072024-11-14T09:07:05.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69082024-11-14T09:07:05.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "028032eb-270d-4299-9c5a-a035320ee741", "content-length": "372", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69092024-11-14T09:07:05.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69102024-11-14T09:07:05.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69112024-11-14T09:07:05.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69122024-11-14T09:07:05.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b5f25c47-8c98-434f-ac00-9bd3cb0d440f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
69132024-11-14T09:07:05.883ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 351.505898ms iteration = 19 status = null
69142024-11-14T09:07:05.885ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 353.921746ms iteration = 19 status = {}
69152024-11-14T09:07:05.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69162024-11-14T09:07:05.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69172024-11-14T09:07:05.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69182024-11-14T09:07:05.889ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69192024-11-14T09:07:05.889ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69202024-11-14T09:07:05.889ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
69212024-11-14T09:07:05.889ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 357.687887ms iteration = 11 status = {"generation":1}
69222024-11-14T09:07:05.909ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69232024-11-14T09:07:05.909ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69242024-11-14T09:07:05.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8d2bc3b7-56b5-44e1-a5a1-4a73013f7c35", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69252024-11-14T09:07:05.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69262024-11-14T09:07:05.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69272024-11-14T09:07:05.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69282024-11-14T09:07:05.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69292024-11-14T09:07:05.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69302024-11-14T09:07:05.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69312024-11-14T09:07:05.919ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69322024-11-14T09:07:05.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69332024-11-14T09:07:05.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cf69d6ac-3aa2-4657-ad38-fa1b855620c9", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69342024-11-14T09:07:05.922ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69352024-11-14T09:07:05.923ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.889036ms iteration = 20 status = {}
69362024-11-14T09:07:05.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69372024-11-14T09:07:05.998ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e72dcfe4-3f8f-411e-b99a-da7a020d2eda", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69382024-11-14T09:07:05.998ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69392024-11-14T09:07:06.000ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "07bd6666-a1df-4aa7-bac5-ecf664540453", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69402024-11-14T09:07:06.000ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69412024-11-14T09:07:06.002ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f780b321-1aec-4369-8007-1d2f7ea96200", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69422024-11-14T09:07:06.002ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69432024-11-14T09:07:06.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69442024-11-14T09:07:06.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69452024-11-14T09:07:06.005ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
69462024-11-14T09:07:06.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 474.121138ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
69472024-11-14T09:07:06.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69482024-11-14T09:07:06.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69492024-11-14T09:07:06.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69502024-11-14T09:07:06.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69512024-11-14T09:07:06.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69522024-11-14T09:07:06.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69532024-11-14T09:07:06.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69542024-11-14T09:07:06.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69552024-11-14T09:07:06.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69562024-11-14T09:07:06.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69572024-11-14T09:07:06.065ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
69582024-11-14T09:07:06.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69592024-11-14T09:07:06.065ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69602024-11-14T09:07:06.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69612024-11-14T09:07:06.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5610f3da-a233-46e5-9f4b-4767d306d32a", "content-length": "691", "date": "Thu, 14 Nov 2024 09:07:06 GMT"} })
69622024-11-14T09:07:06.067ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69632024-11-14T09:07:06.067ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69642024-11-14T09:07:06.067ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69652024-11-14T09:07:06.069ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.79864ms iteration = 19 status = {}
69662024-11-14T09:07:06.080ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69672024-11-14T09:07:06.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa617772-8dbc-4b1b-95fe-77ae29a0b030", "content-length": "134", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69682024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69692024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
69702024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69712024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69722024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69732024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69742024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69752024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69762024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69772024-11-14T09:07:06.081ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69782024-11-14T09:07:06.082ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
69792024-11-14T09:07:06.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69802024-11-14T09:07:06.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69812024-11-14T09:07:06.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69822024-11-14T09:07:06.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe48c2e-4014-40d0-b30f-7743add36fe6", "content-length": "2", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69832024-11-14T09:07:06.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69842024-11-14T09:07:06.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aa60cd2-d74e-43d5-b9dc-bea7453a0002", "content-length": "52", "date": "Thu, 14 Nov 2024 09:07:05 GMT"} })
69852024-11-14T09:07:06.085ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
69862024-11-14T09:07:06.085ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69872024-11-14T09:07:06.333ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f9558004-6031-4578-86c1-6bf5c91ea621", "date": "Thu, 14 Nov 2024 09:07:06 GMT"} })
69882024-11-14T09:07:06.333ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
69892024-11-14T09:07:06.333ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69902024-11-14T09:07:06.333ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "db959883-8760-4149-9841-dac2b8ee86fc", "content-length": "682", "date": "Thu, 14 Nov 2024 09:07:06 GMT"} })
69912024-11-14T09:07:06.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69922024-11-14T09:07:06.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69932024-11-14T09:07:06.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69942024-11-14T09:07:06.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69952024-11-14T09:07:06.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69962024-11-14T09:07:06.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69972024-11-14T09:07:06.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69982024-11-14T09:07:06.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69992024-11-14T09:07:06.350ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 819.043818ms iteration = 19 status = {}
70002024-11-14T09:07:06.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f33a3663-12da-40ab-912d-aa1c45d06715 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70012024-11-14T09:07:06.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f33a3663-12da-40ab-912d-aa1c45d06715 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70022024-11-14T09:07:06.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f33a3663-12da-40ab-912d-aa1c45d06715 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70032024-11-14T09:07:06.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92681e96-f814-4922-8497-1e4c96e19978 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70042024-11-14T09:07:06.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92681e96-f814-4922-8497-1e4c96e19978 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70052024-11-14T09:07:06.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 92681e96-f814-4922-8497-1e4c96e19978 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70062024-11-14T09:07:07.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b53a40f-0af1-4801-b97e-ac77cb3adacf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70072024-11-14T09:07:07.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b53a40f-0af1-4801-b97e-ac77cb3adacf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70082024-11-14T09:07:07.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b53a40f-0af1-4801-b97e-ac77cb3adacf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70092024-11-14T09:07:08.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef0ab629-14bb-46a2-86f7-dd70fd78fd42 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70102024-11-14T09:07:08.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef0ab629-14bb-46a2-86f7-dd70fd78fd42 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70112024-11-14T09:07:08.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ef0ab629-14bb-46a2-86f7-dd70fd78fd42 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70122024-11-14T09:07:09.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5aa2e41a-4303-477e-a323-f11f088fabc6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70132024-11-14T09:07:09.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5aa2e41a-4303-477e-a323-f11f088fabc6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70142024-11-14T09:07:09.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5aa2e41a-4303-477e-a323-f11f088fabc6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70152024-11-14T09:07:11.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4da4d517-35c8-4831-a17c-a9bcc99ad484 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70162024-11-14T09:07:11.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4da4d517-35c8-4831-a17c-a9bcc99ad484 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70172024-11-14T09:07:11.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4da4d517-35c8-4831-a17c-a9bcc99ad484 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70182024-11-14T09:07:12.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5959c4d1-2ead-46d1-8382-b73f1fc90783 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70192024-11-14T09:07:12.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5959c4d1-2ead-46d1-8382-b73f1fc90783 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70202024-11-14T09:07:12.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5959c4d1-2ead-46d1-8382-b73f1fc90783 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70212024-11-14T09:07:13.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5b7ed599-39e8-4a5e-92e3-3c103795627c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70222024-11-14T09:07:13.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5b7ed599-39e8-4a5e-92e3-3c103795627c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70232024-11-14T09:07:13.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5b7ed599-39e8-4a5e-92e3-3c103795627c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70242024-11-14T09:07:14.050ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 01e84e74-a7b2-42a3-8d86-70463f96f1ba response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
70252024-11-14T09:07:14.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f9390ee-67fa-481c-9ecb-c08fec3521d0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70262024-11-14T09:07:14.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f9390ee-67fa-481c-9ecb-c08fec3521d0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70272024-11-14T09:07:14.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f9390ee-67fa-481c-9ecb-c08fec3521d0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70282024-11-14T09:07:15.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a6033f5b-4203-4aa1-87d2-1da318f3393f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70292024-11-14T09:07:15.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a6033f5b-4203-4aa1-87d2-1da318f3393f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70302024-11-14T09:07:15.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a6033f5b-4203-4aa1-87d2-1da318f3393f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70312024-11-14T09:07:15.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
70322024-11-14T09:07:15.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70332024-11-14T09:07:15.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
70342024-11-14T09:07:15.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70352024-11-14T09:07:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70362024-11-14T09:07:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70372024-11-14T09:07:15.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70382024-11-14T09:07:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70392024-11-14T09:07:15.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70402024-11-14T09:07:15.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.100026ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70412024-11-14T09:07:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70422024-11-14T09:07:15.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70432024-11-14T09:07:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70442024-11-14T09:07:15.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70452024-11-14T09:07:15.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70462024-11-14T09:07:15.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70472024-11-14T09:07:15.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
70482024-11-14T09:07:15.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70492024-11-14T09:07:15.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70502024-11-14T09:07:15.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
70512024-11-14T09:07:15.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.102153ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
70522024-11-14T09:07:16.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7b92c066-713f-4afe-a64e-3c1f87de72f2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70532024-11-14T09:07:16.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7b92c066-713f-4afe-a64e-3c1f87de72f2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70542024-11-14T09:07:16.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7b92c066-713f-4afe-a64e-3c1f87de72f2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70552024-11-14T09:07:17.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 074a3f19-1a00-4ed3-8f12-8fcb39c084f6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70562024-11-14T09:07:17.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 074a3f19-1a00-4ed3-8f12-8fcb39c084f6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70572024-11-14T09:07:17.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 074a3f19-1a00-4ed3-8f12-8fcb39c084f6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70582024-11-14T09:07:18.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa8e5dab-dbef-4c73-b5bf-75b875610270 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70592024-11-14T09:07:18.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa8e5dab-dbef-4c73-b5bf-75b875610270 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70602024-11-14T09:07:18.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa8e5dab-dbef-4c73-b5bf-75b875610270 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70612024-11-14T09:07:19.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 021a3818-ddda-4441-a865-61de5a2331a6 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
70622024-11-14T09:07:19.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 021a3818-ddda-4441-a865-61de5a2331a6 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
70632024-11-14T09:07:19.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 021a3818-ddda-4441-a865-61de5a2331a6 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
70642024-11-14T09:07:19.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 21cca3cf-ffac-4cad-8281-fffb80106ee6 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
70652024-11-14T09:07:19.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 21cca3cf-ffac-4cad-8281-fffb80106ee6 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
70662024-11-14T09:07:19.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 21cca3cf-ffac-4cad-8281-fffb80106ee6 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
70672024-11-14T09:07:19.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ab3822fc-3de1-497c-93d4-ca5b93b6d85d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70682024-11-14T09:07:19.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ab3822fc-3de1-497c-93d4-ca5b93b6d85d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70692024-11-14T09:07:19.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ab3822fc-3de1-497c-93d4-ca5b93b6d85d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70702024-11-14T09:07:20.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7436e02d-fd6e-4534-85e2-1b48f42e92ce roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70712024-11-14T09:07:20.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7436e02d-fd6e-4534-85e2-1b48f42e92ce resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70722024-11-14T09:07:20.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7436e02d-fd6e-4534-85e2-1b48f42e92ce response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70732024-11-14T09:07:21.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ce81642-4a34-4381-a48e-ededcb034ceb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70742024-11-14T09:07:21.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ce81642-4a34-4381-a48e-ededcb034ceb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70752024-11-14T09:07:21.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ce81642-4a34-4381-a48e-ededcb034ceb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70762024-11-14T09:07:22.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fa9dd4c6-0fa9-4c66-b61b-3b122cc51c06 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70772024-11-14T09:07:22.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fa9dd4c6-0fa9-4c66-b61b-3b122cc51c06 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70782024-11-14T09:07:22.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fa9dd4c6-0fa9-4c66-b61b-3b122cc51c06 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70792024-11-14T09:07:23.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d33a50dd-f61a-460c-aa26-d1422b213ae5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70802024-11-14T09:07:23.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d33a50dd-f61a-460c-aa26-d1422b213ae5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70812024-11-14T09:07:23.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d33a50dd-f61a-460c-aa26-d1422b213ae5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70822024-11-14T09:07:24.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5e0fbd2-7acd-4615-bee7-3584b64c0062 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70832024-11-14T09:07:24.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5e0fbd2-7acd-4615-bee7-3584b64c0062 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70842024-11-14T09:07:24.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5e0fbd2-7acd-4615-bee7-3584b64c0062 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70852024-11-14T09:07:25.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ebc1245-c1f7-4cbe-8c07-3605570c2bc1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70862024-11-14T09:07:25.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ebc1245-c1f7-4cbe-8c07-3605570c2bc1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70872024-11-14T09:07:25.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ebc1245-c1f7-4cbe-8c07-3605570c2bc1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
70882024-11-14T09:07:25.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
70892024-11-14T09:07:25.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
70902024-11-14T09:07:25.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70912024-11-14T09:07:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70922024-11-14T09:07:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70932024-11-14T09:07:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70942024-11-14T09:07:25.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70952024-11-14T09:07:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70962024-11-14T09:07:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70972024-11-14T09:07:25.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.711669ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70982024-11-14T09:07:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70992024-11-14T09:07:25.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71002024-11-14T09:07:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71012024-11-14T09:07:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71022024-11-14T09:07:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71032024-11-14T09:07:25.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71042024-11-14T09:07:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
71052024-11-14T09:07:25.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71062024-11-14T09:07:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71072024-11-14T09:07:25.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
71082024-11-14T09:07:25.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.463901ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
71092024-11-14T09:07:26.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4ed21d1b-defe-4e95-9b7b-128ef085e1cb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71102024-11-14T09:07:26.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4ed21d1b-defe-4e95-9b7b-128ef085e1cb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71112024-11-14T09:07:26.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4ed21d1b-defe-4e95-9b7b-128ef085e1cb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71122024-11-14T09:07:27.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e55ee942-4321-4366-98a5-47643e25e776 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71132024-11-14T09:07:27.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e55ee942-4321-4366-98a5-47643e25e776 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71142024-11-14T09:07:27.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e55ee942-4321-4366-98a5-47643e25e776 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71152024-11-14T09:07:28.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e63854f6-0259-4315-aa79-77deac8ffd6c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71162024-11-14T09:07:28.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e63854f6-0259-4315-aa79-77deac8ffd6c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71172024-11-14T09:07:28.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e63854f6-0259-4315-aa79-77deac8ffd6c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71182024-11-14T09:07:29.049ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1511 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = daeb2bc1-5c6c-4340-a866-2351fb35a69c response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
71192024-11-14T09:07:29.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f935c85-5463-4e86-ac04-c46c09c150ad roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71202024-11-14T09:07:29.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f935c85-5463-4e86-ac04-c46c09c150ad resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71212024-11-14T09:07:29.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f935c85-5463-4e86-ac04-c46c09c150ad response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71222024-11-14T09:07:30.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 455c5124-cb9f-441b-96a1-eed4c4a5fc57 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71232024-11-14T09:07:30.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 455c5124-cb9f-441b-96a1-eed4c4a5fc57 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71242024-11-14T09:07:30.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 455c5124-cb9f-441b-96a1-eed4c4a5fc57 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71252024-11-14T09:07:31.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 72ff0a94-51bc-4336-818e-48241cc02847 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71262024-11-14T09:07:31.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 72ff0a94-51bc-4336-818e-48241cc02847 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71272024-11-14T09:07:31.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 72ff0a94-51bc-4336-818e-48241cc02847 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71282024-11-14T09:07:32.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 01c9d8b9-a471-489f-8f8d-79bf4b8f5544 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71292024-11-14T09:07:32.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 01c9d8b9-a471-489f-8f8d-79bf4b8f5544 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71302024-11-14T09:07:32.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 01c9d8b9-a471-489f-8f8d-79bf4b8f5544 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71312024-11-14T09:07:33.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1433ac2a-c75a-4e5b-9c08-15ee5a75bff9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71322024-11-14T09:07:33.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1433ac2a-c75a-4e5b-9c08-15ee5a75bff9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71332024-11-14T09:07:33.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1433ac2a-c75a-4e5b-9c08-15ee5a75bff9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71342024-11-14T09:07:34.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fad74a8e-ca9d-43c0-a5c6-48334c28cdd8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71352024-11-14T09:07:34.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fad74a8e-ca9d-43c0-a5c6-48334c28cdd8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71362024-11-14T09:07:34.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fad74a8e-ca9d-43c0-a5c6-48334c28cdd8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
71372024-11-14T09:07:35.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
71382024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71392024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
71402024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
71412024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
71422024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71432024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
71442024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
71452024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71462024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71472024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71482024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
71492024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71502024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71512024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
71522024-11-14T09:07:35.532ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71532024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
71542024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71552024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71562024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
71572024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71582024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
71592024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
71602024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71612024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
71622024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71632024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71642024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71652024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71662024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71672024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71682024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71692024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71702024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71712024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71722024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71732024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71742024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71752024-11-14T09:07:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71762024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
71772024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
71782024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71792024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71802024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
71812024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71822024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
71832024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71842024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71852024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71862024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71872024-11-14T09:07:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71882024-11-14T09:07:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71892024-11-14T09:07:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71902024-11-14T09:07:35.534ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.973248ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71912024-11-14T09:07:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922024-11-14T09:07:35.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71932024-11-14T09:07:35.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 322073116 } })
71942024-11-14T09:07:35.536ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71952024-11-14T09:07:35.536ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71962024-11-14T09:07:35.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71972024-11-14T09:07:35.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71982024-11-14T09:07:35.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
71992024-11-14T09:07:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72002024-11-14T09:07:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72012024-11-14T09:07:35.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72022024-11-14T09:07:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72032024-11-14T09:07:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72042024-11-14T09:07:35.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72052024-11-14T09:07:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72062024-11-14T09:07:35.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72072024-11-14T09:07:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72082024-11-14T09:07:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72092024-11-14T09:07:35.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72102024-11-14T09:07:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72112024-11-14T09:07:35.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 326286684 } })
72122024-11-14T09:07:35.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72132024-11-14T09:07:35.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
72142024-11-14T09:07:35.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72152024-11-14T09:07:35.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162024-11-14T09:07:35.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.449352ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
72172024-11-14T09:07:35.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72182024-11-14T09:07:35.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72192024-11-14T09:07:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72202024-11-14T09:07:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72212024-11-14T09:07:35.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72222024-11-14T09:07:35.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72232024-11-14T09:07:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72242024-11-14T09:07:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72252024-11-14T09:07:35.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72262024-11-14T09:07:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72272024-11-14T09:07:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72282024-11-14T09:07:35.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.159171ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
72292024-11-14T09:07:35.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.871359ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72302024-11-14T09:07:35.548ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72312024-11-14T09:07:35.548ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72322024-11-14T09:07:35.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72332024-11-14T09:07:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72342024-11-14T09:07:35.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.483705ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72352024-11-14T09:07:35.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72362024-11-14T09:07:35.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72372024-11-14T09:07:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72382024-11-14T09:07:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72392024-11-14T09:07:35.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72402024-11-14T09:07:35.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72412024-11-14T09:07:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72422024-11-14T09:07:35.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72432024-11-14T09:07:35.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72442024-11-14T09:07:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72452024-11-14T09:07:35.552ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72462024-11-14T09:07:35.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.868355ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72472024-11-14T09:07:35.554ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 340171347 } })
72482024-11-14T09:07:35.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
72492024-11-14T09:07:35.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72502024-11-14T09:07:35.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72512024-11-14T09:07:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72522024-11-14T09:07:35.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72532024-11-14T09:07:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72542024-11-14T09:07:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
72552024-11-14T09:07:35.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72562024-11-14T09:07:35.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72572024-11-14T09:07:35.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7c9604d-51f3-4760-b6c9-083543ebbbe3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
72582024-11-14T09:07:35.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7c9604d-51f3-4760-b6c9-083543ebbbe3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
72592024-11-14T09:07:35.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
72602024-11-14T09:07:35.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.311188ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
72612024-11-14T09:07:35.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7c9604d-51f3-4760-b6c9-083543ebbbe3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
72622024-11-14T09:07:35.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72632024-11-14T09:07:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72642024-11-14T09:07:35.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 49.78842ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72652024-11-14T09:07:35.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72662024-11-14T09:07:35.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72672024-11-14T09:07:35.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.081767ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72682024-11-14T09:07:35.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72692024-11-14T09:07:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72702024-11-14T09:07:35.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72712024-11-14T09:07:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72722024-11-14T09:07:35.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72732024-11-14T09:07:35.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
72742024-11-14T09:07:35.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72752024-11-14T09:07:35.592ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72762024-11-14T09:07:35.592ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72772024-11-14T09:07:35.592ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.219167ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72782024-11-14T09:07:35.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72792024-11-14T09:07:35.594ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.562285ms iteration = 20 status = 0
72802024-11-14T09:07:35.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72812024-11-14T09:07:35.620ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72822024-11-14T09:07:35.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81cab2fc-e7a7-475b-b2e5-653e6f3b03c4", "content-length": "26", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
72832024-11-14T09:07:35.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72842024-11-14T09:07:35.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72852024-11-14T09:07:35.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72862024-11-14T09:07:35.624ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72872024-11-14T09:07:35.624ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d17e36c-5090-4c3f-9e28-831eebdb9a3f", "content-length": "26", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
72882024-11-14T09:07:35.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72892024-11-14T09:07:35.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72902024-11-14T09:07:35.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
72912024-11-14T09:07:35.653ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72922024-11-14T09:07:35.653ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53b72413-5803-44b2-80b5-7b41118e000b", "content-length": "26", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
72932024-11-14T09:07:35.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72942024-11-14T09:07:35.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
72952024-11-14T09:07:35.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72962024-11-14T09:07:35.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72972024-11-14T09:07:35.677ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.006149ms iteration = 23 status = {"physical_disks_added":0}
72982024-11-14T09:07:35.750ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72992024-11-14T09:07:35.750ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1df4b535-7f61-48c5-9191-fd26b8b774b1", "content-length": "1", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73002024-11-14T09:07:35.751ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73012024-11-14T09:07:35.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73022024-11-14T09:07:35.752ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73032024-11-14T09:07:35.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73042024-11-14T09:07:35.754ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 221.997947ms iteration = 20 status = null
73052024-11-14T09:07:35.754ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "949a47c3-81fe-4c7a-8205-4eb00b393acb", "content-length": "372", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73062024-11-14T09:07:35.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73072024-11-14T09:07:35.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73082024-11-14T09:07:35.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73092024-11-14T09:07:35.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73102024-11-14T09:07:35.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73112024-11-14T09:07:35.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73122024-11-14T09:07:35.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73132024-11-14T09:07:35.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73142024-11-14T09:07:35.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73152024-11-14T09:07:35.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73162024-11-14T09:07:35.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73172024-11-14T09:07:35.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73182024-11-14T09:07:35.773ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73192024-11-14T09:07:35.773ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73202024-11-14T09:07:35.803ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 271.061445ms iteration = 20 status = {}
73212024-11-14T09:07:35.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "56175f1f-f7f6-4dea-990a-a9759f6989d2", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73222024-11-14T09:07:35.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73232024-11-14T09:07:35.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73242024-11-14T09:07:35.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73252024-11-14T09:07:35.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73262024-11-14T09:07:35.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73272024-11-14T09:07:35.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73282024-11-14T09:07:35.881ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73292024-11-14T09:07:35.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73302024-11-14T09:07:35.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "41041445-f17a-4b52-8216-d13333d14e32", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73312024-11-14T09:07:35.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73322024-11-14T09:07:35.884ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 352.035056ms iteration = 21 status = {}
73332024-11-14T09:07:35.884ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "23d4e7e6-18e6-4dee-9e99-9d3dadeae1fa", "content-length": "691", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73342024-11-14T09:07:35.884ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
73352024-11-14T09:07:35.884ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73362024-11-14T09:07:35.884ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73372024-11-14T09:07:35.886ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 354.849282ms iteration = 20 status = {}
73382024-11-14T09:07:35.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73392024-11-14T09:07:35.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73402024-11-14T09:07:35.901ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
73412024-11-14T09:07:35.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73422024-11-14T09:07:35.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73432024-11-14T09:07:35.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73442024-11-14T09:07:35.911ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9619066-45d1-4eb2-93e5-adf2a2ed795f", "content-length": "134", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73452024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73462024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
73472024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73482024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73492024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73502024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73512024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73522024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73532024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73542024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73552024-11-14T09:07:35.911ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
73562024-11-14T09:07:35.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73572024-11-14T09:07:35.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73582024-11-14T09:07:35.914ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73592024-11-14T09:07:35.914ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c8bdae0-b50a-4fe9-88f0-edfb5e6fa8a6", "content-length": "2", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73602024-11-14T09:07:35.914ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73612024-11-14T09:07:35.914ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc9f51a4-913f-4663-8967-40323dd28254", "content-length": "52", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73622024-11-14T09:07:35.914ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
73632024-11-14T09:07:35.914ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73642024-11-14T09:07:36.014ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b1f470f2-8c06-491e-8dcb-e66c9d6b3a53", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73652024-11-14T09:07:36.014ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
73662024-11-14T09:07:36.014ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73672024-11-14T09:07:36.014ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "caf7b01a-b346-4208-915d-118c41515100", "content-length": "682", "date": "Thu, 14 Nov 2024 09:07:35 GMT"} })
73682024-11-14T09:07:36.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73692024-11-14T09:07:36.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73702024-11-14T09:07:36.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73712024-11-14T09:07:36.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73722024-11-14T09:07:36.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73732024-11-14T09:07:36.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73742024-11-14T09:07:36.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73752024-11-14T09:07:36.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73762024-11-14T09:07:36.030ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 498.660642ms iteration = 20 status = {}
73772024-11-14T09:07:36.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 88a79a5c-d75f-41f8-b2c7-48c8f1142445 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73782024-11-14T09:07:36.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 88a79a5c-d75f-41f8-b2c7-48c8f1142445 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73792024-11-14T09:07:36.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 88a79a5c-d75f-41f8-b2c7-48c8f1142445 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73802024-11-14T09:07:36.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = d6682677-9f48-41b8-9205-00ebcbb40b53 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73812024-11-14T09:07:36.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = d6682677-9f48-41b8-9205-00ebcbb40b53 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73822024-11-14T09:07:36.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = d6682677-9f48-41b8-9205-00ebcbb40b53 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73832024-11-14T09:07:37.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f3100b12-fc42-4f66-924f-e3cca39d63fd roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73842024-11-14T09:07:37.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f3100b12-fc42-4f66-924f-e3cca39d63fd resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73852024-11-14T09:07:37.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f3100b12-fc42-4f66-924f-e3cca39d63fd response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73862024-11-14T09:07:38.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1f868f7-250a-46d1-bcf7-de5aa4164b88 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73872024-11-14T09:07:38.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1f868f7-250a-46d1-bcf7-de5aa4164b88 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73882024-11-14T09:07:38.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1f868f7-250a-46d1-bcf7-de5aa4164b88 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73892024-11-14T09:07:39.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e5cc7065-f747-4994-a896-d67dcecaaad9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73902024-11-14T09:07:39.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e5cc7065-f747-4994-a896-d67dcecaaad9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73912024-11-14T09:07:39.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e5cc7065-f747-4994-a896-d67dcecaaad9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73922024-11-14T09:07:40.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 50eca638-4d6d-4692-b01b-a36f7f96b003 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73932024-11-14T09:07:40.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 50eca638-4d6d-4692-b01b-a36f7f96b003 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73942024-11-14T09:07:40.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 50eca638-4d6d-4692-b01b-a36f7f96b003 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73952024-11-14T09:07:41.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7ad54606-9d1f-47b0-9ba7-7c0b7a34f6c0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73962024-11-14T09:07:41.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7ad54606-9d1f-47b0-9ba7-7c0b7a34f6c0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73972024-11-14T09:07:41.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7ad54606-9d1f-47b0-9ba7-7c0b7a34f6c0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73982024-11-14T09:07:42.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 76a37e9a-1c67-4e05-bcf0-0ba1cd7a6079 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
73992024-11-14T09:07:42.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 76a37e9a-1c67-4e05-bcf0-0ba1cd7a6079 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74002024-11-14T09:07:42.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 76a37e9a-1c67-4e05-bcf0-0ba1cd7a6079 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74012024-11-14T09:07:43.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 241dc178-aaff-42a8-bdf9-0b3484c5c7d2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74022024-11-14T09:07:43.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 241dc178-aaff-42a8-bdf9-0b3484c5c7d2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74032024-11-14T09:07:43.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 241dc178-aaff-42a8-bdf9-0b3484c5c7d2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74042024-11-14T09:07:44.049ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1443 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 6e2e99b0-bdf3-46b7-bd64-e212ec62d83a response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
74052024-11-14T09:07:44.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e2d2bef-59ff-473c-b357-a0d59f4c7567 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74062024-11-14T09:07:44.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e2d2bef-59ff-473c-b357-a0d59f4c7567 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74072024-11-14T09:07:44.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5e2d2bef-59ff-473c-b357-a0d59f4c7567 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74082024-11-14T09:07:45.531ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
74092024-11-14T09:07:45.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74102024-11-14T09:07:45.531ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
74112024-11-14T09:07:45.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74122024-11-14T09:07:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74132024-11-14T09:07:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74142024-11-14T09:07:45.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74152024-11-14T09:07:45.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74162024-11-14T09:07:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74172024-11-14T09:07:45.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74182024-11-14T09:07:45.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74192024-11-14T09:07:45.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74202024-11-14T09:07:45.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74212024-11-14T09:07:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74222024-11-14T09:07:45.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.736674ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74232024-11-14T09:07:45.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74242024-11-14T09:07:45.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
74252024-11-14T09:07:45.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74262024-11-14T09:07:45.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74272024-11-14T09:07:45.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
74282024-11-14T09:07:45.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.079642ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
74292024-11-14T09:07:45.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5eb754de-747a-435f-8d82-a40a85215900 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74302024-11-14T09:07:45.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5eb754de-747a-435f-8d82-a40a85215900 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74312024-11-14T09:07:45.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5eb754de-747a-435f-8d82-a40a85215900 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74322024-11-14T09:07:46.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 498b1606-0f85-4d3f-bbe2-09a0e00cce5a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74332024-11-14T09:07:46.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 498b1606-0f85-4d3f-bbe2-09a0e00cce5a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74342024-11-14T09:07:46.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 498b1606-0f85-4d3f-bbe2-09a0e00cce5a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74352024-11-14T09:07:47.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eccf7a2c-3fdc-4970-abc6-1c94f6a791c0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74362024-11-14T09:07:47.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eccf7a2c-3fdc-4970-abc6-1c94f6a791c0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74372024-11-14T09:07:47.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eccf7a2c-3fdc-4970-abc6-1c94f6a791c0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74382024-11-14T09:07:48.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 294528ae-6d58-475f-aade-340e0132d4f9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74392024-11-14T09:07:48.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 294528ae-6d58-475f-aade-340e0132d4f9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74402024-11-14T09:07:48.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 294528ae-6d58-475f-aade-340e0132d4f9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74412024-11-14T09:07:49.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = f58674aa-8447-4a0d-8c6d-8b489b9eadf0 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
74422024-11-14T09:07:49.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = f58674aa-8447-4a0d-8c6d-8b489b9eadf0 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
74432024-11-14T09:07:49.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = f58674aa-8447-4a0d-8c6d-8b489b9eadf0 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
74442024-11-14T09:07:49.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 00376b29-2688-4e6d-8f4f-7731f1c1fc8c roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
74452024-11-14T09:07:49.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 00376b29-2688-4e6d-8f4f-7731f1c1fc8c resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
74462024-11-14T09:07:49.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 00376b29-2688-4e6d-8f4f-7731f1c1fc8c response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
74472024-11-14T09:07:49.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 970efb68-b058-41d5-98fb-6262ebc40ef0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74482024-11-14T09:07:49.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 970efb68-b058-41d5-98fb-6262ebc40ef0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74492024-11-14T09:07:49.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 970efb68-b058-41d5-98fb-6262ebc40ef0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74502024-11-14T09:07:50.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6a1536a-75c0-41c1-8a96-a1b1d3fcb8db roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74512024-11-14T09:07:50.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6a1536a-75c0-41c1-8a96-a1b1d3fcb8db resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74522024-11-14T09:07:50.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6a1536a-75c0-41c1-8a96-a1b1d3fcb8db response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74532024-11-14T09:07:51.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9587c507-cf25-4deb-afe8-9cd0a0eb9881 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74542024-11-14T09:07:51.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9587c507-cf25-4deb-afe8-9cd0a0eb9881 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74552024-11-14T09:07:51.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9587c507-cf25-4deb-afe8-9cd0a0eb9881 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74562024-11-14T09:07:52.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f221521-36a9-4ce7-95a4-2174a11f3b25 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74572024-11-14T09:07:52.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f221521-36a9-4ce7-95a4-2174a11f3b25 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74582024-11-14T09:07:52.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f221521-36a9-4ce7-95a4-2174a11f3b25 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74592024-11-14T09:07:53.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af9d41ed-3127-45fc-b1ff-57d98f4cb732 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74602024-11-14T09:07:53.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af9d41ed-3127-45fc-b1ff-57d98f4cb732 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74612024-11-14T09:07:53.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af9d41ed-3127-45fc-b1ff-57d98f4cb732 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74622024-11-14T09:07:55.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f340414f-b444-4d67-bdd6-b26b66178f5b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74632024-11-14T09:07:55.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f340414f-b444-4d67-bdd6-b26b66178f5b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74642024-11-14T09:07:55.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f340414f-b444-4d67-bdd6-b26b66178f5b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74652024-11-14T09:07:55.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
74662024-11-14T09:07:55.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
74672024-11-14T09:07:55.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74682024-11-14T09:07:55.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74692024-11-14T09:07:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74702024-11-14T09:07:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74712024-11-14T09:07:55.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74722024-11-14T09:07:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74732024-11-14T09:07:55.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74742024-11-14T09:07:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74752024-11-14T09:07:55.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74762024-11-14T09:07:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74772024-11-14T09:07:55.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74782024-11-14T09:07:55.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
74792024-11-14T09:07:55.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74802024-11-14T09:07:55.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74812024-11-14T09:07:55.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
74822024-11-14T09:07:55.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.085103ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
74832024-11-14T09:07:55.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74842024-11-14T09:07:55.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74852024-11-14T09:07:55.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.774933ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74862024-11-14T09:07:56.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9034a7e1-0e92-496c-bf54-d7baea89f0df roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74872024-11-14T09:07:56.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9034a7e1-0e92-496c-bf54-d7baea89f0df resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74882024-11-14T09:07:56.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9034a7e1-0e92-496c-bf54-d7baea89f0df response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74892024-11-14T09:07:57.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 155ff552-88f6-4ea6-a3f6-69fab9ab36b5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74902024-11-14T09:07:57.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 155ff552-88f6-4ea6-a3f6-69fab9ab36b5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74912024-11-14T09:07:57.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 155ff552-88f6-4ea6-a3f6-69fab9ab36b5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74922024-11-14T09:07:58.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aae48347-39db-41d2-b871-829f01a5dc27 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74932024-11-14T09:07:58.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aae48347-39db-41d2-b871-829f01a5dc27 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74942024-11-14T09:07:58.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aae48347-39db-41d2-b871-829f01a5dc27 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74952024-11-14T09:07:59.048ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1325 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = cd743fa0-64ae-4c53-a282-e5548c96aa5b response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
74962024-11-14T09:07:59.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f9ed3816-30d0-4024-8277-7ddcdd3349a2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74972024-11-14T09:07:59.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f9ed3816-30d0-4024-8277-7ddcdd3349a2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74982024-11-14T09:07:59.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f9ed3816-30d0-4024-8277-7ddcdd3349a2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
74992024-11-14T09:08:00.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b478d69d-d532-469c-bbd7-d979776761a4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75002024-11-14T09:08:00.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b478d69d-d532-469c-bbd7-d979776761a4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75012024-11-14T09:08:00.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b478d69d-d532-469c-bbd7-d979776761a4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75022024-11-14T09:08:01.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1777c85e-cdf5-4b03-a21f-4dab69b212ae roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75032024-11-14T09:08:01.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1777c85e-cdf5-4b03-a21f-4dab69b212ae resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75042024-11-14T09:08:01.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1777c85e-cdf5-4b03-a21f-4dab69b212ae response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75052024-11-14T09:08:02.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 82610572-8d89-4555-8621-2b1b528f0f3e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75062024-11-14T09:08:02.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 82610572-8d89-4555-8621-2b1b528f0f3e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75072024-11-14T09:08:02.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 82610572-8d89-4555-8621-2b1b528f0f3e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75082024-11-14T09:08:03.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f687611d-63da-4de5-a765-c2f69f9faab4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75092024-11-14T09:08:03.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f687611d-63da-4de5-a765-c2f69f9faab4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75102024-11-14T09:08:03.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f687611d-63da-4de5-a765-c2f69f9faab4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75112024-11-14T09:08:04.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cbfa4187-8633-440c-bc9a-af5926bfb25b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75122024-11-14T09:08:04.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cbfa4187-8633-440c-bc9a-af5926bfb25b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75132024-11-14T09:08:04.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cbfa4187-8633-440c-bc9a-af5926bfb25b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75142024-11-14T09:08:05.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d10bd9e-fa50-45f2-8fe9-9ffee091a3f5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75152024-11-14T09:08:05.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d10bd9e-fa50-45f2-8fe9-9ffee091a3f5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75162024-11-14T09:08:05.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d10bd9e-fa50-45f2-8fe9-9ffee091a3f5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
75172024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
75182024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75192024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
75202024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75212024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
75222024-11-14T09:08:05.532ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:58:05.532115408 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75232024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
75242024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75252024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
75262024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75272024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75282024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
75292024-11-14T09:08:05.532ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
75302024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75312024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
75322024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
75332024-11-14T09:08:05.532ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
75342024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.25\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
75352024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
75362024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
75372024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75382024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
75392024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
75402024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
75412024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75422024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75432024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
75442024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75452024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
75462024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
75472024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
75482024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75492024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75502024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75512024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75522024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
75532024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
75542024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75552024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
75562024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75572024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
75582024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75592024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
75602024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75612024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
75622024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75632024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
75642024-11-14T09:08:05.532ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75652024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75662024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
75672024-11-14T09:08:05.532ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75682024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75692024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
75702024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75712024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75722024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75732024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75742024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75752024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75762024-11-14T09:08:05.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75772024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75782024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75792024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75802024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75812024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75822024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75832024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75842024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75852024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75862024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75872024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75882024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
75892024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75902024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
75912024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75922024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75932024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75942024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
75952024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75962024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
75972024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
75982024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
75992024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76002024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76012024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76022024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76032024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
76042024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76052024-11-14T09:08:05.533ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
76062024-11-14T09:08:05.533ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
76072024-11-14T09:08:05.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 318737603 } })
76082024-11-14T09:08:05.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 318754093 } })
76092024-11-14T09:08:05.533ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
76102024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76112024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76122024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76132024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76142024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76152024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76162024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76172024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.586005ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76182024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
76192024-11-14T09:08:05.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.521645ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
76202024-11-14T09:08:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76212024-11-14T09:08:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76222024-11-14T09:08:05.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 321663930 } })
76232024-11-14T09:08:05.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
76242024-11-14T09:08:05.536ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:58:05.532115408 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76252024-11-14T09:08:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.673205ms iteration = 11 status = {"expiration":"2024-11-14T08:58:05.532115408Z","pruned":[]}
76262024-11-14T09:08:05.537ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.731246ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76272024-11-14T09:08:05.537ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76282024-11-14T09:08:05.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76292024-11-14T09:08:05.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76302024-11-14T09:08:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76312024-11-14T09:08:05.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76322024-11-14T09:08:05.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76332024-11-14T09:08:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76342024-11-14T09:08:05.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 326188773 } })
76352024-11-14T09:08:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
76362024-11-14T09:08:05.540ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76372024-11-14T09:08:05.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
76382024-11-14T09:08:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76392024-11-14T09:08:05.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76402024-11-14T09:08:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76412024-11-14T09:08:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76422024-11-14T09:08:05.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76432024-11-14T09:08:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76442024-11-14T09:08:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76452024-11-14T09:08:05.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76462024-11-14T09:08:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76472024-11-14T09:08:05.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-11-14T09:08:05.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492024-11-14T09:08:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76502024-11-14T09:08:05.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76512024-11-14T09:08:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76522024-11-14T09:08:05.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76532024-11-14T09:08:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76542024-11-14T09:08:05.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76552024-11-14T09:08:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76562024-11-14T09:08:05.551ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76572024-11-14T09:08:05.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76582024-11-14T09:08:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76592024-11-14T09:08:05.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76602024-11-14T09:08:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76612024-11-14T09:08:05.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76622024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76632024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76642024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76652024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76662024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76672024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76682024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76692024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76702024-11-14T09:08:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76712024-11-14T09:08:05.557ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.88586ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
76722024-11-14T09:08:05.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76732024-11-14T09:08:05.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76742024-11-14T09:08:05.564ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(319dcd4a-aa88-4066-9afc-f6093215a7f1, 0), (64316450-8730-4483-9917-19408ad2b121, 0), (582efc13-1345-4cf1-b4be-43aa2a9165c0, 0)]
76752024-11-14T09:08:05.565ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 351106133 } })
76762024-11-14T09:08:05.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76772024-11-14T09:08:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76782024-11-14T09:08:05.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76792024-11-14T09:08:05.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 353366319 } })
76802024-11-14T09:08:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76812024-11-14T09:08:05.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
76822024-11-14T09:08:05.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76832024-11-14T09:08:05.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76842024-11-14T09:08:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76852024-11-14T09:08:05.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76862024-11-14T09:08:05.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76872024-11-14T09:08:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76882024-11-14T09:08:05.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76892024-11-14T09:08:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76902024-11-14T09:08:05.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76912024-11-14T09:08:05.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76922024-11-14T09:08:05.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76932024-11-14T09:08:05.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76942024-11-14T09:08:05.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76952024-11-14T09:08:05.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76962024-11-14T09:08:05.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-11-14T09:08:05.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76982024-11-14T09:08:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76992024-11-14T09:08:05.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77002024-11-14T09:08:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77012024-11-14T09:08:05.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77022024-11-14T09:08:05.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77032024-11-14T09:08:05.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77042024-11-14T09:08:05.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77052024-11-14T09:08:05.607ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77062024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77072024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77082024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.265125ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77092024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77102024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
77112024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77122024-11-14T09:08:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77132024-11-14T09:08:05.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77142024-11-14T09:08:05.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77152024-11-14T09:08:05.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 81.875115ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
77162024-11-14T09:08:05.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.614657ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
77172024-11-14T09:08:05.619ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
77182024-11-14T09:08:05.619ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 49925e09-56ca-45d7-b951-17c4d92f1e38
77192024-11-14T09:08:05.619ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 1da1829f-37bd-4c2f-9fac-c9187e5c3fb6
77202024-11-14T09:08:05.619ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = bde2d9ee-eb1c-4245-8847-57ca7bce69de
77212024-11-14T09:08:05.619ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 1da1829f-37bd-4c2f-9fac-c9187e5c3fb6
77222024-11-14T09:08:05.619ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 49925e09-56ca-45d7-b951-17c4d92f1e38
77232024-11-14T09:08:05.619ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = bde2d9ee-eb1c-4245-8847-57ca7bce69de
77242024-11-14T09:08:05.619ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77252024-11-14T09:08:05.619ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77262024-11-14T09:08:05.619ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.599651ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77272024-11-14T09:08:05.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77282024-11-14T09:08:05.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77292024-11-14T09:08:05.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77302024-11-14T09:08:05.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77312024-11-14T09:08:05.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77322024-11-14T09:08:05.623ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 90.486614ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
77332024-11-14T09:08:05.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77342024-11-14T09:08:05.627ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77352024-11-14T09:08:05.627ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77362024-11-14T09:08:05.627ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77372024-11-14T09:08:05.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77382024-11-14T09:08:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77392024-11-14T09:08:05.628ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77402024-11-14T09:08:05.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.923001ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77412024-11-14T09:08:05.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.234252ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77422024-11-14T09:08:05.631ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77432024-11-14T09:08:05.631ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77442024-11-14T09:08:05.631ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.602164ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77452024-11-14T09:08:05.634ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77462024-11-14T09:08:05.634ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77472024-11-14T09:08:05.634ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77482024-11-14T09:08:05.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77492024-11-14T09:08:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77502024-11-14T09:08:05.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 5b5cecba-fe40-4637-b8e1-d5a10ecbc7fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77512024-11-14T09:08:05.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 5b5cecba-fe40-4637-b8e1-d5a10ecbc7fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77522024-11-14T09:08:05.673ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77532024-11-14T09:08:05.673ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77542024-11-14T09:08:05.696ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77552024-11-14T09:08:05.696ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.119717ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77562024-11-14T09:08:05.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77572024-11-14T09:08:05.720ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77582024-11-14T09:08:05.720ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "92cec7ae-0d30-4819-a405-0721f109293f", "content-length": "26", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77592024-11-14T09:08:05.720ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77602024-11-14T09:08:05.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77612024-11-14T09:08:05.733ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77622024-11-14T09:08:05.734ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77632024-11-14T09:08:05.734ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "848c28f7-1856-451d-851e-2857b410fd88", "content-length": "26", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77642024-11-14T09:08:05.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77652024-11-14T09:08:05.735ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77662024-11-14T09:08:05.760ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77672024-11-14T09:08:05.760ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77682024-11-14T09:08:05.760ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c259fec-dda7-40f3-a50a-95e316a65490", "content-length": "372", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77692024-11-14T09:08:05.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77702024-11-14T09:08:05.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77712024-11-14T09:08:05.762ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77722024-11-14T09:08:05.762ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77732024-11-14T09:08:05.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77742024-11-14T09:08:05.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77752024-11-14T09:08:05.765ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77762024-11-14T09:08:05.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77772024-11-14T09:08:05.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77782024-11-14T09:08:05.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77792024-11-14T09:08:05.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 5b5cecba-fe40-4637-b8e1-d5a10ecbc7fe response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77802024-11-14T09:08:05.774ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
77812024-11-14T09:08:05.774ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77822024-11-14T09:08:05.775ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57f82acc-a9a5-4ee6-8fc0-2bf487a90844", "content-length": "26", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77832024-11-14T09:08:05.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77842024-11-14T09:08:05.776ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
77852024-11-14T09:08:05.776ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
77862024-11-14T09:08:05.776ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
77872024-11-14T09:08:05.777ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "246abf4d-00c2-4a3b-9288-8d93688b33e4", "content-length": "476", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77882024-11-14T09:08:05.777ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
77892024-11-14T09:08:05.777ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6ce7bc6-d739-4821-9e14-e5dfb03a222d", "content-length": "734", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77902024-11-14T09:08:05.777ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
77912024-11-14T09:08:05.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
77922024-11-14T09:08:05.777ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0415fbdd-67be-4c9f-8281-728fb80108af", "content-length": "111", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77932024-11-14T09:08:05.777ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
77942024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8c3ab7d-aa7f-4205-b25f-e72ea9b6e905", "content-length": "111", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77952024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
77962024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
77972024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "012ffae2-674b-4e3e-b83a-c2bcb7d60267", "content-length": "167", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
77982024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 246.147025ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
77992024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
78002024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff811433-f9ef-4aa8-ab56-0fa4fd1241f3", "content-length": "167", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78012024-11-14T09:08:05.778ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
78022024-11-14T09:08:05.779ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36cc35c6-f431-4ac9-a94b-3219acbd2d5f", "content-length": "175", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78032024-11-14T09:08:05.779ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
78042024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "82248cb4-21f6-4d61-bc23-5e7a1a318a26", "content-length": "175", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78052024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
78062024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ffd2a5d-6841-4ce1-8e86-ea9dbec59537", "content-length": "702", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78072024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
78082024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ab062aa-71a7-4475-9adf-b84e36cf0350", "content-length": "727", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78092024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
78102024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ce3ffdb-73ca-4ca1-bcdc-2e6cee7ce11b", "content-length": "729", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78112024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
78122024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f36bc58-4c26-4933-b526-8b8c82a7162a", "content-length": "728", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78132024-11-14T09:08:05.780ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
78142024-11-14T09:08:05.781ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3428bed-f012-4fbb-bacc-51ca7a992b4e", "content-length": "722", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78152024-11-14T09:08:05.781ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
78162024-11-14T09:08:05.781ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a46e6640-2404-4211-bacc-2a61d81ce7e0", "content-length": "109", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78172024-11-14T09:08:05.781ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
78182024-11-14T09:08:05.781ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a600ce38-a97e-4a6c-968c-3570ca025b10", "content-length": "109", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78192024-11-14T09:08:05.781ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
78202024-11-14T09:08:05.782ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae35e914-61a2-4c3d-939f-f1fd81fe20b0", "content-length": "169", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78212024-11-14T09:08:05.782ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
78222024-11-14T09:08:05.782ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7754a77f-e585-438a-ac2f-9fadee8f7259", "content-length": "169", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78232024-11-14T09:08:05.782ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
78242024-11-14T09:08:05.783ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f14e9123-8d77-4bd8-af8b-d4ab3fb97184", "content-length": "178", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78252024-11-14T09:08:05.783ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
78262024-11-14T09:08:05.783ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8a10a25-6a10-40ea-9be7-11862a3df096", "content-length": "178", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78272024-11-14T09:08:05.783ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
78282024-11-14T09:08:05.783ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "801a7f48-7ff3-46ea-831f-eadffb251bc6", "content-length": "702", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78292024-11-14T09:08:05.783ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
78302024-11-14T09:08:05.784ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4402550e-38ef-4382-a6f7-6dc189a5f6f2", "content-length": "727", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78312024-11-14T09:08:05.784ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
78322024-11-14T09:08:05.784ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9dedfb6-23b0-4dad-b653-a11e3a1d85a8", "content-length": "729", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78332024-11-14T09:08:05.784ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
78342024-11-14T09:08:05.784ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0e0c76-cdf8-4f40-b1e2-33ec076ab6fd", "content-length": "728", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78352024-11-14T09:08:05.784ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78362024-11-14T09:08:05.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78372024-11-14T09:08:05.797ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78382024-11-14T09:08:05.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
78392024-11-14T09:08:05.800ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78402024-11-14T09:08:05.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78412024-11-14T09:08:05.803ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78422024-11-14T09:08:05.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
78432024-11-14T09:08:05.806ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78442024-11-14T09:08:05.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78452024-11-14T09:08:05.810ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78462024-11-14T09:08:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78472024-11-14T09:08:05.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 281.732086ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78482024-11-14T09:08:05.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78492024-11-14T09:08:05.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78502024-11-14T09:08:05.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78512024-11-14T09:08:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78522024-11-14T09:08:05.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78532024-11-14T09:08:05.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78542024-11-14T09:08:05.822ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78552024-11-14T09:08:05.823ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78562024-11-14T09:08:05.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 290.67005ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78572024-11-14T09:08:05.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78582024-11-14T09:08:05.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78592024-11-14T09:08:05.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78602024-11-14T09:08:05.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78612024-11-14T09:08:05.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78622024-11-14T09:08:05.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78632024-11-14T09:08:05.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
78642024-11-14T09:08:05.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78652024-11-14T09:08:05.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78662024-11-14T09:08:05.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78672024-11-14T09:08:05.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78682024-11-14T09:08:05.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78692024-11-14T09:08:05.837ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78702024-11-14T09:08:05.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78712024-11-14T09:08:05.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ba2b259e-cc75-4cdd-8e72-95b2154428f2", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78722024-11-14T09:08:05.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78732024-11-14T09:08:05.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78742024-11-14T09:08:05.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 318.715011ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78752024-11-14T09:08:05.855ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78762024-11-14T09:08:05.855ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
78772024-11-14T09:08:05.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78782024-11-14T09:08:05.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78792024-11-14T09:08:05.856ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78802024-11-14T09:08:05.857ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f84e19e4-f1f0-4428-9b7f-e08e845c2c25", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78812024-11-14T09:08:05.857ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78822024-11-14T09:08:05.859ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "50c3dc7e-93ac-48ca-ad18-b8be35d34f4d", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78832024-11-14T09:08:05.859ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78842024-11-14T09:08:05.859ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78852024-11-14T09:08:05.860ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78862024-11-14T09:08:05.860ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ec084e-9304-4f4c-87d3-38d68b7c49aa", "content-length": "1", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
78872024-11-14T09:08:05.862ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78882024-11-14T09:08:05.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 329.993072ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78892024-11-14T09:08:05.863ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78902024-11-14T09:08:05.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78912024-11-14T09:08:05.885ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 352.703477ms iteration = 24 status = {"physical_disks_added":0}
78922024-11-14T09:08:05.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78932024-11-14T09:08:05.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78942024-11-14T09:08:05.899ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.947575ms iteration = 21 status = {}
78952024-11-14T09:08:05.927ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
78962024-11-14T09:08:05.927ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
78972024-11-14T09:08:05.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 397.368674ms iteration = 21 status = 0
78982024-11-14T09:08:05.930ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
78992024-11-14T09:08:05.930ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79002024-11-14T09:08:05.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79012024-11-14T09:08:05.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79022024-11-14T09:08:05.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79032024-11-14T09:08:05.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79042024-11-14T09:08:05.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79052024-11-14T09:08:05.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79062024-11-14T09:08:05.931ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.802794ms iteration = 21 status = null
79072024-11-14T09:08:05.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79082024-11-14T09:08:05.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79092024-11-14T09:08:05.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79102024-11-14T09:08:05.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79112024-11-14T09:08:05.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79122024-11-14T09:08:05.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79132024-11-14T09:08:05.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79142024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
79152024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79162024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
79172024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 408.676186ms iteration = 12 status = {"generation":2}
79182024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79192024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79202024-11-14T09:08:05.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79212024-11-14T09:08:05.944ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79222024-11-14T09:08:05.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79232024-11-14T09:08:05.944ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
79242024-11-14T09:08:05.944ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79252024-11-14T09:08:05.945ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
79262024-11-14T09:08:05.945ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 412.706811ms iteration = 12 status = {"generation":1}
79272024-11-14T09:08:05.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79282024-11-14T09:08:05.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "49af5620-7b95-4c2c-a535-2297dcb8d5e6", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79292024-11-14T09:08:05.945ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79302024-11-14T09:08:05.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "71cd27c5-51c1-4989-bd73-cd14afeb0634", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79312024-11-14T09:08:05.948ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79322024-11-14T09:08:05.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a0de50aa-ee23-47e9-a3d4-b1c35b3e7b85", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79332024-11-14T09:08:05.950ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79342024-11-14T09:08:05.950ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79352024-11-14T09:08:05.950ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79362024-11-14T09:08:05.952ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79372024-11-14T09:08:05.952ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 420.13679ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79382024-11-14T09:08:05.953ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c265421f-b56d-46e2-b63d-02ff8b43bf03", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
79392024-11-14T09:08:05.956ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 424.110284ms iteration = 22 status = {}
79402024-11-14T09:08:05.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79412024-11-14T09:08:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
79422024-11-14T09:08:05.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79432024-11-14T09:08:05.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79442024-11-14T09:08:05.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79452024-11-14T09:08:05.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79462024-11-14T09:08:05.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79472024-11-14T09:08:05.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79482024-11-14T09:08:05.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79492024-11-14T09:08:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79502024-11-14T09:08:05.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79512024-11-14T09:08:05.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79522024-11-14T09:08:05.998ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
79532024-11-14T09:08:05.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79542024-11-14T09:08:05.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79552024-11-14T09:08:06.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79562024-11-14T09:08:06.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79572024-11-14T09:08:06.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79582024-11-14T09:08:06.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79592024-11-14T09:08:06.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79602024-11-14T09:08:06.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79612024-11-14T09:08:06.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79622024-11-14T09:08:06.010ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e499338-ff74-4188-b92f-4f71b956bcd0", "content-length": "134", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
79632024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79642024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
79652024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79662024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79672024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79682024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79692024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79702024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79712024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79722024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79732024-11-14T09:08:06.010ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
79742024-11-14T09:08:06.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79752024-11-14T09:08:06.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79762024-11-14T09:08:06.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79772024-11-14T09:08:06.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79782024-11-14T09:08:06.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5db1bf9-86a7-499f-a473-e7380ea699da", "content-length": "2", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
79792024-11-14T09:08:06.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79802024-11-14T09:08:06.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c46e98d8-e562-47a7-8148-54d7233fb1d9", "content-length": "52", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
79812024-11-14T09:08:06.015ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
79822024-11-14T09:08:06.015ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79832024-11-14T09:08:06.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79842024-11-14T09:08:06.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79852024-11-14T09:08:06.035ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
79862024-11-14T09:08:06.035ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 503.147703ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79872024-11-14T09:08:06.036ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79882024-11-14T09:08:06.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
79892024-11-14T09:08:06.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79902024-11-14T09:08:06.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79912024-11-14T09:08:06.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79922024-11-14T09:08:06.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79932024-11-14T09:08:06.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79942024-11-14T09:08:06.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79952024-11-14T09:08:06.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79962024-11-14T09:08:06.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79972024-11-14T09:08:06.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79982024-11-14T09:08:06.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79992024-11-14T09:08:06.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80002024-11-14T09:08:06.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80012024-11-14T09:08:06.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80022024-11-14T09:08:06.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80032024-11-14T09:08:06.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80042024-11-14T09:08:06.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc769c64-88a2-47ab-84ed-945efde8e91b", "content-length": "691", "date": "Thu, 14 Nov 2024 09:08:06 GMT"} })
80052024-11-14T09:08:06.059ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80062024-11-14T09:08:06.059ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80072024-11-14T09:08:06.059ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80082024-11-14T09:08:06.060ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 528.347209ms iteration = 21 status = {}
80092024-11-14T09:08:06.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
80102024-11-14T09:08:06.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80112024-11-14T09:08:06.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80122024-11-14T09:08:06.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80132024-11-14T09:08:06.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80142024-11-14T09:08:06.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80152024-11-14T09:08:06.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80162024-11-14T09:08:06.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80172024-11-14T09:08:06.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80182024-11-14T09:08:06.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80192024-11-14T09:08:06.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80202024-11-14T09:08:06.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80212024-11-14T09:08:06.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80222024-11-14T09:08:06.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80232024-11-14T09:08:06.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80242024-11-14T09:08:06.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80252024-11-14T09:08:06.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
80262024-11-14T09:08:06.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80272024-11-14T09:08:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80282024-11-14T09:08:06.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80292024-11-14T09:08:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80302024-11-14T09:08:06.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80312024-11-14T09:08:06.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80322024-11-14T09:08:06.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80332024-11-14T09:08:06.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
80342024-11-14T09:08:06.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80352024-11-14T09:08:06.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80362024-11-14T09:08:06.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80372024-11-14T09:08:06.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80382024-11-14T09:08:06.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80392024-11-14T09:08:06.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80402024-11-14T09:08:06.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80412024-11-14T09:08:06.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80422024-11-14T09:08:06.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80432024-11-14T09:08:06.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80442024-11-14T09:08:06.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80452024-11-14T09:08:06.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80462024-11-14T09:08:06.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80472024-11-14T09:08:06.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80482024-11-14T09:08:06.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80492024-11-14T09:08:06.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80502024-11-14T09:08:06.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512024-11-14T09:08:06.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80522024-11-14T09:08:06.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80532024-11-14T09:08:06.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80542024-11-14T09:08:06.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80552024-11-14T09:08:06.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80562024-11-14T09:08:06.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80572024-11-14T09:08:06.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80582024-11-14T09:08:06.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80592024-11-14T09:08:06.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80602024-11-14T09:08:06.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80612024-11-14T09:08:06.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80622024-11-14T09:08:06.157ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
80632024-11-14T09:08:06.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80642024-11-14T09:08:06.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80652024-11-14T09:08:06.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80662024-11-14T09:08:06.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
80672024-11-14T09:08:06.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80682024-11-14T09:08:06.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80692024-11-14T09:08:06.163ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
80702024-11-14T09:08:06.163ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
80712024-11-14T09:08:06.163ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
80722024-11-14T09:08:06.287ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 65d2236a-3110-4d84-aa25-77e21779db87, time_created: 2024-11-14T08:58:18.385723Z, time_modified: 2024-11-14T08:58:18.385723Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
80732024-11-14T09:08:06.287ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
80742024-11-14T09:08:06.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80752024-11-14T09:08:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80762024-11-14T09:08:06.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80772024-11-14T09:08:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80782024-11-14T09:08:06.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-11-14T09:08:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
80802024-11-14T09:08:06.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 960a5517-289d-45d2-8843-5f99525dc13b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
80812024-11-14T09:08:06.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 960a5517-289d-45d2-8843-5f99525dc13b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
80822024-11-14T09:08:06.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 960a5517-289d-45d2-8843-5f99525dc13b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
80832024-11-14T09:08:06.327ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
80842024-11-14T09:08:06.332ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "369ad8d0-9ae1-421d-a68e-3badf338366a", "date": "Thu, 14 Nov 2024 09:08:06 GMT"} })
80852024-11-14T09:08:06.334ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
80862024-11-14T09:08:06.334ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 802.271869ms
80872024-11-14T09:08:06.334ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 802.284439ms iteration = 3 status = {}
80882024-11-14T09:08:06.395ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "91ae510f-2bfd-4a20-bfef-b664d535b3ac", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
80892024-11-14T09:08:06.395ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
80902024-11-14T09:08:06.395ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80912024-11-14T09:08:06.396ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "67776387-9b7d-41d3-945e-47c2f5997d3f", "content-length": "682", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
80922024-11-14T09:08:06.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80932024-11-14T09:08:06.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80942024-11-14T09:08:06.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80952024-11-14T09:08:06.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80962024-11-14T09:08:06.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80972024-11-14T09:08:06.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80982024-11-14T09:08:06.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80992024-11-14T09:08:06.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81002024-11-14T09:08:06.414ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 882.053361ms iteration = 21 status = {}
81012024-11-14T09:08:06.438ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f747875-587d-4bc6-9df6-15bc569a5526", "content-length": "30764", "date": "Thu, 14 Nov 2024 09:08:05 GMT"} })
81022024-11-14T09:08:06.440ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
81032024-11-14T09:08:06.440ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
81042024-11-14T09:08:06.440ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
81052024-11-14T09:08:06.441ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81062024-11-14T09:08:06.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81072024-11-14T09:08:06.443ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81082024-11-14T09:08:06.445ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
81092024-11-14T09:08:06.445ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81102024-11-14T09:08:06.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81112024-11-14T09:08:06.604ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 045179f3-8ad6-45b5-ad3f-74124f824376 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
81122024-11-14T09:08:06.604ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 045179f3-8ad6-45b5-ad3f-74124f824376 time_started = 2024-11-14 09:08:05.776619 UTC
81132024-11-14T09:08:06.604ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.072497351s iteration = 4 status = {"collection_id":"045179f3-8ad6-45b5-ad3f-74124f824376","time_done":"2024-11-14 09:08:06.440167 UTC","time_started":"2024-11-14 09:08:05.776619 UTC"}
81142024-11-14T09:08:06.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
81152024-11-14T09:08:06.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81162024-11-14T09:08:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81172024-11-14T09:08:06.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81182024-11-14T09:08:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81192024-11-14T09:08:06.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81202024-11-14T09:08:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81212024-11-14T09:08:06.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81222024-11-14T09:08:06.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81232024-11-14T09:08:06.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81242024-11-14T09:08:06.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81252024-11-14T09:08:06.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81262024-11-14T09:08:06.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81272024-11-14T09:08:06.715ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.656568ms iteration = 25 status = {"physical_disks_added":0}
81282024-11-14T09:08:07.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 655ec93c-1157-4291-8dd2-a52b28ebdcf6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81292024-11-14T09:08:07.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 655ec93c-1157-4291-8dd2-a52b28ebdcf6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81302024-11-14T09:08:07.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 655ec93c-1157-4291-8dd2-a52b28ebdcf6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81312024-11-14T09:08:08.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7ab458d1-de6d-4872-82de-a26432a522e8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81322024-11-14T09:08:08.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7ab458d1-de6d-4872-82de-a26432a522e8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81332024-11-14T09:08:08.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7ab458d1-de6d-4872-82de-a26432a522e8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81342024-11-14T09:08:09.094ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33504
81352024-11-14T09:08:09.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33504 req_id = cc555b6f-5c61-441b-9537-37c0f1692a6d roles = RoleSet { roles: {} } uri = /metrics/producers
81362024-11-14T09:08:09.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33504 req_id = cc555b6f-5c61-441b-9537-37c0f1692a6d resource = Database result = Ok(()) uri = /metrics/producers
81372024-11-14T09:08:09.130ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 90e4e05f-b4bf-4b2e-9770-f73b3d2c05fa
81382024-11-14T09:08:09.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35880 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33504 req_id = cc555b6f-5c61-441b-9537-37c0f1692a6d response_code = 201 uri = /metrics/producers
81392024-11-14T09:08:09.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 30f0fbbe-f14c-4ab0-956e-0ac3e437e683 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81402024-11-14T09:08:09.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 30f0fbbe-f14c-4ab0-956e-0ac3e437e683 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81412024-11-14T09:08:09.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 30f0fbbe-f14c-4ab0-956e-0ac3e437e683 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81422024-11-14T09:08:09.841ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51168
81432024-11-14T09:08:09.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51168 req_id = 11763f6c-148c-450f-a812-1565290b2cee roles = RoleSet { roles: {} } uri = /metrics/producers
81442024-11-14T09:08:09.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51168 req_id = 11763f6c-148c-450f-a812-1565290b2cee resource = Database result = Ok(()) uri = /metrics/producers
81452024-11-14T09:08:09.877ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 0a0adcc5-bcdd-46d2-a222-ace3abfe409c
81462024-11-14T09:08:09.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36479 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51168 req_id = 11763f6c-148c-450f-a812-1565290b2cee response_code = 201 uri = /metrics/producers
81472024-11-14T09:08:10.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ac55d12-43cd-460a-a7c5-6cba77ec0dd4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81482024-11-14T09:08:10.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ac55d12-43cd-460a-a7c5-6cba77ec0dd4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81492024-11-14T09:08:10.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1ac55d12-43cd-460a-a7c5-6cba77ec0dd4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81502024-11-14T09:08:11.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12bc9a93-5e89-47b1-a06e-62ec6a60e183 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81512024-11-14T09:08:11.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12bc9a93-5e89-47b1-a06e-62ec6a60e183 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81522024-11-14T09:08:11.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12bc9a93-5e89-47b1-a06e-62ec6a60e183 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81532024-11-14T09:08:12.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7abe122c-f7b2-4a49-9bbe-a20218a327e8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81542024-11-14T09:08:12.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7abe122c-f7b2-4a49-9bbe-a20218a327e8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81552024-11-14T09:08:12.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7abe122c-f7b2-4a49-9bbe-a20218a327e8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81562024-11-14T09:08:13.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d307e14-4730-441a-b4d8-9d8e591fab14 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81572024-11-14T09:08:13.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d307e14-4730-441a-b4d8-9d8e591fab14 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81582024-11-14T09:08:13.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d307e14-4730-441a-b4d8-9d8e591fab14 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81592024-11-14T09:08:14.050ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = c6eeb2d8-4768-4089-ae4b-5e75df32667c response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
81602024-11-14T09:08:14.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5921a0f8-6ca3-40db-aac1-b0909ec7fedf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81612024-11-14T09:08:14.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5921a0f8-6ca3-40db-aac1-b0909ec7fedf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81622024-11-14T09:08:14.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5921a0f8-6ca3-40db-aac1-b0909ec7fedf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81632024-11-14T09:08:15.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 07c9fd7f-84d6-4e70-8e6b-8f611106defc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81642024-11-14T09:08:15.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 07c9fd7f-84d6-4e70-8e6b-8f611106defc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81652024-11-14T09:08:15.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 07c9fd7f-84d6-4e70-8e6b-8f611106defc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81662024-11-14T09:08:15.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
81672024-11-14T09:08:15.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
81682024-11-14T09:08:15.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81692024-11-14T09:08:15.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81702024-11-14T09:08:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81712024-11-14T09:08:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81722024-11-14T09:08:15.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81732024-11-14T09:08:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81742024-11-14T09:08:15.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81752024-11-14T09:08:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81762024-11-14T09:08:15.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81772024-11-14T09:08:15.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81782024-11-14T09:08:15.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81792024-11-14T09:08:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
81802024-11-14T09:08:15.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81812024-11-14T09:08:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81822024-11-14T09:08:15.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
81832024-11-14T09:08:15.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.644504ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
81842024-11-14T09:08:15.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81852024-11-14T09:08:15.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81862024-11-14T09:08:15.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.50572ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81872024-11-14T09:08:15.781ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:65389
81882024-11-14T09:08:15.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65389 req_id = 66eeb181-22d8-4725-8433-9dafc728e025 roles = RoleSet { roles: {} } uri = /metrics/producers
81892024-11-14T09:08:15.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65389 req_id = 66eeb181-22d8-4725-8433-9dafc728e025 resource = Database result = Ok(()) uri = /metrics/producers
81902024-11-14T09:08:15.791ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 4ceca43a-03cf-4e69-8d70-2c7628b44304
81912024-11-14T09:08:15.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10492 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65389 req_id = 66eeb181-22d8-4725-8433-9dafc728e025 response_code = 201 uri = /metrics/producers
81922024-11-14T09:08:16.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bcf54737-cfaf-493a-86c7-ab4d612092d3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81932024-11-14T09:08:16.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bcf54737-cfaf-493a-86c7-ab4d612092d3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81942024-11-14T09:08:16.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bcf54737-cfaf-493a-86c7-ab4d612092d3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
81952024-11-14T09:08:17.200ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:56430
81962024-11-14T09:08:17.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56430 req_id = dda9e0b2-7f7f-4551-8b70-c4b455038500 roles = RoleSet { roles: {} } uri = /metrics/producers
81972024-11-14T09:08:17.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56430 req_id = dda9e0b2-7f7f-4551-8b70-c4b455038500 resource = Database result = Ok(()) uri = /metrics/producers
81982024-11-14T09:08:17.208ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 65d2236a-3110-4d84-aa25-77e21779db87
81992024-11-14T09:08:17.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8270 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56430 req_id = dda9e0b2-7f7f-4551-8b70-c4b455038500 response_code = 201 uri = /metrics/producers
82002024-11-14T09:08:17.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ebbe69ef-7dd4-44bf-a5ec-831662983cde roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82012024-11-14T09:08:17.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ebbe69ef-7dd4-44bf-a5ec-831662983cde resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82022024-11-14T09:08:17.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ebbe69ef-7dd4-44bf-a5ec-831662983cde response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82032024-11-14T09:08:18.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0367494e-057b-4d76-aab4-4084692d9c63 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82042024-11-14T09:08:18.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0367494e-057b-4d76-aab4-4084692d9c63 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82052024-11-14T09:08:18.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0367494e-057b-4d76-aab4-4084692d9c63 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82062024-11-14T09:08:18.779ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40707
82072024-11-14T09:08:18.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40707 req_id = ac286d64-ba07-4841-82c3-3a5a907ecfca roles = RoleSet { roles: {} } uri = /metrics/producers
82082024-11-14T09:08:18.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40707 req_id = ac286d64-ba07-4841-82c3-3a5a907ecfca resource = Database result = Ok(()) uri = /metrics/producers
82092024-11-14T09:08:18.787ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 92786f50-3ada-49c6-9f91-967466d8804f
82102024-11-14T09:08:18.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8132 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40707 req_id = ac286d64-ba07-4841-82c3-3a5a907ecfca response_code = 201 uri = /metrics/producers
82112024-11-14T09:08:19.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 5d7497ad-d7fd-4ad3-9421-97155e170197 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
82122024-11-14T09:08:19.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 5d7497ad-d7fd-4ad3-9421-97155e170197 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
82132024-11-14T09:08:19.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 5d7497ad-d7fd-4ad3-9421-97155e170197 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
82142024-11-14T09:08:19.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = b6e5e87d-6c5c-47a7-9e19-855715d1d2c5 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
82152024-11-14T09:08:19.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = b6e5e87d-6c5c-47a7-9e19-855715d1d2c5 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
82162024-11-14T09:08:19.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = b6e5e87d-6c5c-47a7-9e19-855715d1d2c5 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
82172024-11-14T09:08:19.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e1d81321-78cd-465d-939c-fabf8d2a6aad roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82182024-11-14T09:08:19.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e1d81321-78cd-465d-939c-fabf8d2a6aad resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82192024-11-14T09:08:19.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e1d81321-78cd-465d-939c-fabf8d2a6aad response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82202024-11-14T09:08:20.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d3d1c79-04ef-4e6e-89fd-5245b0e8cc98 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82212024-11-14T09:08:20.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d3d1c79-04ef-4e6e-89fd-5245b0e8cc98 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82222024-11-14T09:08:20.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d3d1c79-04ef-4e6e-89fd-5245b0e8cc98 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82232024-11-14T09:08:20.871ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60066
82242024-11-14T09:08:20.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60066 req_id = 2495af6b-08c4-4d9c-a480-32b75d704ff5 roles = RoleSet { roles: {} } uri = /metrics/producers
82252024-11-14T09:08:20.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60066 req_id = 2495af6b-08c4-4d9c-a480-32b75d704ff5 resource = Database result = Ok(()) uri = /metrics/producers
82262024-11-14T09:08:20.887ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = c91f550b-068d-4077-a493-b226555a9b58
82272024-11-14T09:08:20.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13775 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60066 req_id = 2495af6b-08c4-4d9c-a480-32b75d704ff5 response_code = 201 uri = /metrics/producers
82282024-11-14T09:08:21.220ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
82292024-11-14T09:08:21.220ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
82302024-11-14T09:08:21.250ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
82312024-11-14T09:08:21.251ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62192
82322024-11-14T09:08:21.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62192 req_id = 0a198bed-a26d-4f02-8427-82efa6832ebd roles = RoleSet { roles: {} } uri = /metrics/producers
82332024-11-14T09:08:21.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62192 req_id = 0a198bed-a26d-4f02-8427-82efa6832ebd resource = Database result = Ok(()) uri = /metrics/producers
82342024-11-14T09:08:21.288ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 484a1c50-302f-49ec-9214-2179c2ff7104
82352024-11-14T09:08:21.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36920 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62192 req_id = 0a198bed-a26d-4f02-8427-82efa6832ebd response_code = 201 uri = /metrics/producers
82362024-11-14T09:08:21.288ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0a198bed-a26d-4f02-8427-82efa6832ebd", "content-length": "41", "date": "Thu, 14 Nov 2024 09:08:20 GMT"} })
82372024-11-14T09:08:21.289ZDEBGnexus (producer-registration-task): registered with nexus successfully
82382024-11-14T09:08:21.289ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
82392024-11-14T09:08:21.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8388cdc1-32ac-4624-b4ce-69e3bf0ec4ad roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82402024-11-14T09:08:21.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8388cdc1-32ac-4624-b4ce-69e3bf0ec4ad resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82412024-11-14T09:08:21.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8388cdc1-32ac-4624-b4ce-69e3bf0ec4ad response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82422024-11-14T09:08:22.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2293e7b5-2a8b-4141-a9d3-7b88901f6ee6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82432024-11-14T09:08:22.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2293e7b5-2a8b-4141-a9d3-7b88901f6ee6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82442024-11-14T09:08:22.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2293e7b5-2a8b-4141-a9d3-7b88901f6ee6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82452024-11-14T09:08:23.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc09dae7-f64e-44b4-91c8-50cc9ff7248d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82462024-11-14T09:08:23.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc09dae7-f64e-44b4-91c8-50cc9ff7248d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82472024-11-14T09:08:23.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc09dae7-f64e-44b4-91c8-50cc9ff7248d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82482024-11-14T09:08:24.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74dd6996-12f2-420f-8ce3-152a3d2ffecd roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82492024-11-14T09:08:24.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74dd6996-12f2-420f-8ce3-152a3d2ffecd resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82502024-11-14T09:08:24.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74dd6996-12f2-420f-8ce3-152a3d2ffecd response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82512024-11-14T09:08:25.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
82522024-11-14T09:08:25.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
82532024-11-14T09:08:25.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82542024-11-14T09:08:25.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82552024-11-14T09:08:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82562024-11-14T09:08:25.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82572024-11-14T09:08:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82582024-11-14T09:08:25.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82592024-11-14T09:08:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82602024-11-14T09:08:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82612024-11-14T09:08:25.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82622024-11-14T09:08:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82632024-11-14T09:08:25.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82642024-11-14T09:08:25.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82652024-11-14T09:08:25.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82662024-11-14T09:08:25.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
82672024-11-14T09:08:25.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82682024-11-14T09:08:25.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82692024-11-14T09:08:25.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
82702024-11-14T09:08:25.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.574831ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
82712024-11-14T09:08:25.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.189854ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82722024-11-14T09:08:25.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 90975610-6e0c-4b2e-8537-fcceb42f6fd8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82732024-11-14T09:08:25.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 90975610-6e0c-4b2e-8537-fcceb42f6fd8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82742024-11-14T09:08:25.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 90975610-6e0c-4b2e-8537-fcceb42f6fd8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82752024-11-14T09:08:26.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63c00633-e8e0-48ec-a44f-d72ea43d34bb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82762024-11-14T09:08:26.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63c00633-e8e0-48ec-a44f-d72ea43d34bb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82772024-11-14T09:08:26.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63c00633-e8e0-48ec-a44f-d72ea43d34bb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82782024-11-14T09:08:27.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 14d428c1-4883-4d93-bd31-c75c6031b487 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82792024-11-14T09:08:27.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 14d428c1-4883-4d93-bd31-c75c6031b487 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82802024-11-14T09:08:27.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 14d428c1-4883-4d93-bd31-c75c6031b487 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82812024-11-14T09:08:28.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 71876088-a89f-40c7-8880-172ed70c5cd1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82822024-11-14T09:08:28.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 71876088-a89f-40c7-8880-172ed70c5cd1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82832024-11-14T09:08:28.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 71876088-a89f-40c7-8880-172ed70c5cd1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82842024-11-14T09:08:29.049ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1568 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = f833d58c-fa56-42a5-b537-a25d8dc23692 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
82852024-11-14T09:08:29.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d62e2f66-b784-4bb3-a3af-922f9aef4f9b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82862024-11-14T09:08:29.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d62e2f66-b784-4bb3-a3af-922f9aef4f9b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82872024-11-14T09:08:29.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d62e2f66-b784-4bb3-a3af-922f9aef4f9b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82882024-11-14T09:08:30.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7216722e-0a45-4560-91ce-8c99d2f9f739 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82892024-11-14T09:08:30.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7216722e-0a45-4560-91ce-8c99d2f9f739 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82902024-11-14T09:08:30.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7216722e-0a45-4560-91ce-8c99d2f9f739 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82912024-11-14T09:08:31.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e3cf9e63-f667-489b-bbb7-6c71bdf3b4a4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82922024-11-14T09:08:31.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e3cf9e63-f667-489b-bbb7-6c71bdf3b4a4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82932024-11-14T09:08:31.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e3cf9e63-f667-489b-bbb7-6c71bdf3b4a4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82942024-11-14T09:08:32.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1528dc95-a30a-4e17-ac6d-b0352f24d9e0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82952024-11-14T09:08:32.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1528dc95-a30a-4e17-ac6d-b0352f24d9e0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82962024-11-14T09:08:32.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1528dc95-a30a-4e17-ac6d-b0352f24d9e0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82972024-11-14T09:08:33.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 301c371f-eb01-46a0-833d-09edbb485f08 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82982024-11-14T09:08:33.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 301c371f-eb01-46a0-833d-09edbb485f08 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
82992024-11-14T09:08:33.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 301c371f-eb01-46a0-833d-09edbb485f08 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
83002024-11-14T09:08:34.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0af3cdf-654e-4f0e-8ec1-e08c33ce7eee roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
83012024-11-14T09:08:34.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0af3cdf-654e-4f0e-8ec1-e08c33ce7eee resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
83022024-11-14T09:08:34.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0af3cdf-654e-4f0e-8ec1-e08c33ce7eee response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
83032024-11-14T09:08:35.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
83042024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
83052024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83062024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
83072024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83082024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
83092024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
83102024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83112024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83122024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83132024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
83142024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
83152024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83162024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83172024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
83182024-11-14T09:08:35.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83192024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
83202024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83212024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83222024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
83232024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83242024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
83252024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
83262024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83272024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83282024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
83292024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83302024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83312024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83322024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
83332024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
83342024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83352024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83362024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83372024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83382024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
83392024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
83402024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83412024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83422024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83432024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83442024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83452024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83462024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83472024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83482024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83492024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83502024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83512024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83522024-11-14T09:08:35.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83532024-11-14T09:08:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83542024-11-14T09:08:35.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83552024-11-14T09:08:35.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.439695ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83562024-11-14T09:08:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83572024-11-14T09:08:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83582024-11-14T09:08:35.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83592024-11-14T09:08:35.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 322539684 } })
83602024-11-14T09:08:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83612024-11-14T09:08:35.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83622024-11-14T09:08:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83632024-11-14T09:08:35.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
83642024-11-14T09:08:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83652024-11-14T09:08:35.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83662024-11-14T09:08:35.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83672024-11-14T09:08:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83682024-11-14T09:08:35.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83692024-11-14T09:08:35.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 326450637 } })
83702024-11-14T09:08:35.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
83712024-11-14T09:08:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83722024-11-14T09:08:35.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83732024-11-14T09:08:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83742024-11-14T09:08:35.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83752024-11-14T09:08:35.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83762024-11-14T09:08:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83772024-11-14T09:08:35.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83782024-11-14T09:08:35.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83792024-11-14T09:08:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83802024-11-14T09:08:35.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83812024-11-14T09:08:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83822024-11-14T09:08:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83832024-11-14T09:08:35.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83842024-11-14T09:08:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83852024-11-14T09:08:35.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83862024-11-14T09:08:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83872024-11-14T09:08:35.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 342883751 } })
83882024-11-14T09:08:35.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83892024-11-14T09:08:35.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
83902024-11-14T09:08:35.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83912024-11-14T09:08:35.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83922024-11-14T09:08:35.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83932024-11-14T09:08:35.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83942024-11-14T09:08:35.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83952024-11-14T09:08:35.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83962024-11-14T09:08:35.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83972024-11-14T09:08:35.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83982024-11-14T09:08:35.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83992024-11-14T09:08:35.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002024-11-14T09:08:35.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
84012024-11-14T09:08:35.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84022024-11-14T09:08:35.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84032024-11-14T09:08:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84042024-11-14T09:08:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84052024-11-14T09:08:35.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84062024-11-14T09:08:35.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84072024-11-14T09:08:35.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84082024-11-14T09:08:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84092024-11-14T09:08:35.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84102024-11-14T09:08:35.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84112024-11-14T09:08:35.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84122024-11-14T09:08:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84132024-11-14T09:08:35.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
84142024-11-14T09:08:35.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.472556ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
84152024-11-14T09:08:35.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84162024-11-14T09:08:35.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84172024-11-14T09:08:35.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84182024-11-14T09:08:35.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84192024-11-14T09:08:35.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.574469ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
84202024-11-14T09:08:35.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84212024-11-14T09:08:35.596ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84222024-11-14T09:08:35.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84232024-11-14T09:08:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84242024-11-14T09:08:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84252024-11-14T09:08:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84262024-11-14T09:08:35.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.606444ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84272024-11-14T09:08:35.599ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84282024-11-14T09:08:35.599ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.190333ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84292024-11-14T09:08:35.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84302024-11-14T09:08:35.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84312024-11-14T09:08:35.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84322024-11-14T09:08:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84332024-11-14T09:08:35.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.770671ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
84342024-11-14T09:08:35.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84352024-11-14T09:08:35.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
84362024-11-14T09:08:35.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84372024-11-14T09:08:35.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84382024-11-14T09:08:35.610ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.700839ms iteration = 22 status = 0
84392024-11-14T09:08:35.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84402024-11-14T09:08:35.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84412024-11-14T09:08:35.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84422024-11-14T09:08:35.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84432024-11-14T09:08:35.616ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
84442024-11-14T09:08:35.616ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84452024-11-14T09:08:35.617ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "238bdc32-eac3-4c1b-92b0-f4c4e6dc753d", "content-length": "26", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84462024-11-14T09:08:35.617ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84472024-11-14T09:08:35.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84482024-11-14T09:08:35.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
84492024-11-14T09:08:35.624ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84502024-11-14T09:08:35.624ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "787491b5-f49f-416c-ab07-a344eb9715e9", "content-length": "26", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84512024-11-14T09:08:35.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84522024-11-14T09:08:35.626ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84532024-11-14T09:08:35.626ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84542024-11-14T09:08:35.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84552024-11-14T09:08:35.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84562024-11-14T09:08:35.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84572024-11-14T09:08:35.630ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
84582024-11-14T09:08:35.630ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84592024-11-14T09:08:35.630ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c00b368-3468-4089-828d-ed4b6f2625bb", "content-length": "26", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84602024-11-14T09:08:35.630ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84612024-11-14T09:08:35.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.3141ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84622024-11-14T09:08:35.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
84632024-11-14T09:08:35.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84642024-11-14T09:08:35.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84652024-11-14T09:08:35.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.530142ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
84662024-11-14T09:08:35.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.743455ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84672024-11-14T09:08:35.669ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84682024-11-14T09:08:35.669ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84692024-11-14T09:08:35.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.771327ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84702024-11-14T09:08:35.719ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 186.143491ms iteration = 22 status = {}
84712024-11-14T09:08:35.722ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.583986ms iteration = 26 status = {"physical_disks_added":0}
84722024-11-14T09:08:35.733ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84732024-11-14T09:08:35.733ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "345d90a3-d437-4dbe-baa2-69a68c98595e", "content-length": "1", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84742024-11-14T09:08:35.735ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84752024-11-14T09:08:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84762024-11-14T09:08:35.737ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.856661ms iteration = 22 status = null
84772024-11-14T09:08:35.758ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84782024-11-14T09:08:35.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f76b216a-e18d-46a1-ba07-26703bb7c4aa", "content-length": "691", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84792024-11-14T09:08:35.758ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84802024-11-14T09:08:35.758ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84812024-11-14T09:08:35.758ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84822024-11-14T09:08:35.758ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84832024-11-14T09:08:35.758ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84842024-11-14T09:08:35.759ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "10f543c9-3a1e-4358-abb8-bb1509b6c934", "content-length": "372", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84852024-11-14T09:08:35.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84862024-11-14T09:08:35.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84872024-11-14T09:08:35.760ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 227.687048ms iteration = 22 status = {}
84882024-11-14T09:08:35.800ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84892024-11-14T09:08:35.800ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84902024-11-14T09:08:35.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 8bc6b187-a6fb-40d8-8a70-89126c4b7d9c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
84912024-11-14T09:08:35.801ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "482e08eb-cd07-4137-9d6c-9e0eba018744", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
84922024-11-14T09:08:35.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84932024-11-14T09:08:35.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 8bc6b187-a6fb-40d8-8a70-89126c4b7d9c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
84942024-11-14T09:08:35.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84952024-11-14T09:08:35.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 8bc6b187-a6fb-40d8-8a70-89126c4b7d9c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
84962024-11-14T09:08:35.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84972024-11-14T09:08:35.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84982024-11-14T09:08:35.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84992024-11-14T09:08:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85002024-11-14T09:08:35.810ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85012024-11-14T09:08:35.810ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85022024-11-14T09:08:35.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85032024-11-14T09:08:35.811ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3fccde95-e249-4afa-923c-d9536d539d94", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
85042024-11-14T09:08:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85052024-11-14T09:08:35.814ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.977304ms iteration = 23 status = {}
85062024-11-14T09:08:35.814ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
85072024-11-14T09:08:35.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85082024-11-14T09:08:35.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85092024-11-14T09:08:35.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85102024-11-14T09:08:35.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d9c0c4b-eefd-44db-93a3-cef72a024799", "content-length": "134", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
85112024-11-14T09:08:35.823ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85122024-11-14T09:08:35.823ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
85132024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85142024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85152024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85162024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85172024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85182024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85192024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85202024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85212024-11-14T09:08:35.824ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
85222024-11-14T09:08:35.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85232024-11-14T09:08:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85242024-11-14T09:08:35.826ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85252024-11-14T09:08:35.826ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "eefc5a0d-866e-418d-9ad4-017f5b364145", "content-length": "2", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
85262024-11-14T09:08:35.826ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85272024-11-14T09:08:35.826ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf22059-2907-40b7-92cd-991f06d625b4", "content-length": "52", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
85282024-11-14T09:08:35.826ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
85292024-11-14T09:08:35.826ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85302024-11-14T09:08:35.945ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "764a076f-b431-4023-8d66-6fd397a9c8fe", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
85312024-11-14T09:08:35.946ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
85322024-11-14T09:08:35.946ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85332024-11-14T09:08:35.946ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0816a1cc-1055-430d-befa-c9aef1e3c872", "content-length": "682", "date": "Thu, 14 Nov 2024 09:08:35 GMT"} })
85342024-11-14T09:08:35.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85352024-11-14T09:08:35.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85362024-11-14T09:08:35.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85372024-11-14T09:08:35.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85382024-11-14T09:08:35.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85392024-11-14T09:08:35.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85402024-11-14T09:08:35.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85412024-11-14T09:08:35.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85422024-11-14T09:08:35.962ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.776605ms iteration = 22 status = {}
85432024-11-14T09:08:35.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b8128ef-ae14-4d35-8dab-a041d2366350 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85442024-11-14T09:08:35.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b8128ef-ae14-4d35-8dab-a041d2366350 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85452024-11-14T09:08:35.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b8128ef-ae14-4d35-8dab-a041d2366350 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85462024-11-14T09:08:37.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bee62d70-7de9-42ab-9ffb-fce3eceacec1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85472024-11-14T09:08:37.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bee62d70-7de9-42ab-9ffb-fce3eceacec1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85482024-11-14T09:08:37.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bee62d70-7de9-42ab-9ffb-fce3eceacec1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85492024-11-14T09:08:38.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d5c57c5-4652-4260-9350-cba509d84992 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85502024-11-14T09:08:38.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d5c57c5-4652-4260-9350-cba509d84992 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85512024-11-14T09:08:38.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d5c57c5-4652-4260-9350-cba509d84992 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85522024-11-14T09:08:39.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 47336d70-5afb-4186-a006-44168a758e17 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85532024-11-14T09:08:39.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 47336d70-5afb-4186-a006-44168a758e17 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85542024-11-14T09:08:39.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 47336d70-5afb-4186-a006-44168a758e17 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85552024-11-14T09:08:40.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c5f68d4-4e1c-44c6-b090-d9dbc179d5d3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85562024-11-14T09:08:40.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c5f68d4-4e1c-44c6-b090-d9dbc179d5d3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85572024-11-14T09:08:40.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c5f68d4-4e1c-44c6-b090-d9dbc179d5d3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85582024-11-14T09:08:41.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = de183f90-e214-4afe-aaa3-0fe476f7ca4a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85592024-11-14T09:08:41.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = de183f90-e214-4afe-aaa3-0fe476f7ca4a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85602024-11-14T09:08:41.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = de183f90-e214-4afe-aaa3-0fe476f7ca4a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85612024-11-14T09:08:42.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a83fa497-7296-4169-82f9-0846bba112ac roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85622024-11-14T09:08:42.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a83fa497-7296-4169-82f9-0846bba112ac resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85632024-11-14T09:08:42.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a83fa497-7296-4169-82f9-0846bba112ac response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85642024-11-14T09:08:43.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6e02b780-5ab7-45f6-aa3a-67bb4fe84e5c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85652024-11-14T09:08:43.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6e02b780-5ab7-45f6-aa3a-67bb4fe84e5c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85662024-11-14T09:08:43.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6e02b780-5ab7-45f6-aa3a-67bb4fe84e5c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85672024-11-14T09:08:44.050ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1376 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = fc38c69f-ffc5-4a89-98e6-24da947a419a response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
85682024-11-14T09:08:44.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e52f538f-71d8-4aac-b6df-f66bb233ebf8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85692024-11-14T09:08:44.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e52f538f-71d8-4aac-b6df-f66bb233ebf8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85702024-11-14T09:08:44.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e52f538f-71d8-4aac-b6df-f66bb233ebf8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85712024-11-14T09:08:45.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 197035a9-2b01-46e3-9a0a-218a7100cebb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85722024-11-14T09:08:45.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 197035a9-2b01-46e3-9a0a-218a7100cebb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85732024-11-14T09:08:45.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 197035a9-2b01-46e3-9a0a-218a7100cebb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85742024-11-14T09:08:45.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
85752024-11-14T09:08:45.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
85762024-11-14T09:08:45.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85772024-11-14T09:08:45.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85782024-11-14T09:08:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85792024-11-14T09:08:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85802024-11-14T09:08:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85812024-11-14T09:08:45.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85822024-11-14T09:08:45.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85832024-11-14T09:08:45.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85842024-11-14T09:08:45.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85852024-11-14T09:08:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85862024-11-14T09:08:45.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85872024-11-14T09:08:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
85882024-11-14T09:08:45.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85892024-11-14T09:08:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85902024-11-14T09:08:45.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
85912024-11-14T09:08:45.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.208363ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
85922024-11-14T09:08:45.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85932024-11-14T09:08:45.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85942024-11-14T09:08:45.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.487149ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85952024-11-14T09:08:46.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dfc37ff7-788e-4c17-b2df-182238669d77 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85962024-11-14T09:08:46.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dfc37ff7-788e-4c17-b2df-182238669d77 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85972024-11-14T09:08:46.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dfc37ff7-788e-4c17-b2df-182238669d77 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85982024-11-14T09:08:47.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be804575-46ee-4efd-9c10-a1882539e300 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
85992024-11-14T09:08:47.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be804575-46ee-4efd-9c10-a1882539e300 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86002024-11-14T09:08:47.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be804575-46ee-4efd-9c10-a1882539e300 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86012024-11-14T09:08:48.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78ac8453-655c-491d-9128-7943985f5336 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86022024-11-14T09:08:48.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78ac8453-655c-491d-9128-7943985f5336 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86032024-11-14T09:08:48.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78ac8453-655c-491d-9128-7943985f5336 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86042024-11-14T09:08:49.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3cb2fd32-bf6e-4915-a1a5-2ad5878c398f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86052024-11-14T09:08:49.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3cb2fd32-bf6e-4915-a1a5-2ad5878c398f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86062024-11-14T09:08:49.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3cb2fd32-bf6e-4915-a1a5-2ad5878c398f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86072024-11-14T09:08:50.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2d79850-53ee-4af7-978d-f8110aeee77e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86082024-11-14T09:08:50.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2d79850-53ee-4af7-978d-f8110aeee77e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86092024-11-14T09:08:50.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f2d79850-53ee-4af7-978d-f8110aeee77e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86102024-11-14T09:08:51.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74c0db1e-b9f3-4dfa-be26-a6682a60d281 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86112024-11-14T09:08:51.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74c0db1e-b9f3-4dfa-be26-a6682a60d281 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86122024-11-14T09:08:51.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74c0db1e-b9f3-4dfa-be26-a6682a60d281 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86132024-11-14T09:08:52.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0560c014-f157-43af-a2dd-f67d97ab6b45 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86142024-11-14T09:08:52.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0560c014-f157-43af-a2dd-f67d97ab6b45 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86152024-11-14T09:08:52.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0560c014-f157-43af-a2dd-f67d97ab6b45 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86162024-11-14T09:08:53.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4c20608c-6912-4bc8-8b29-de988e4bc391 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86172024-11-14T09:08:53.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4c20608c-6912-4bc8-8b29-de988e4bc391 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86182024-11-14T09:08:53.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4c20608c-6912-4bc8-8b29-de988e4bc391 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86192024-11-14T09:08:54.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c41e63d-0e54-4cb0-baf5-ea3e146cefc3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86202024-11-14T09:08:54.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c41e63d-0e54-4cb0-baf5-ea3e146cefc3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86212024-11-14T09:08:54.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c41e63d-0e54-4cb0-baf5-ea3e146cefc3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86222024-11-14T09:08:55.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ef74f86-3d5a-45e6-b33e-360968380d8b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86232024-11-14T09:08:55.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ef74f86-3d5a-45e6-b33e-360968380d8b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86242024-11-14T09:08:55.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ef74f86-3d5a-45e6-b33e-360968380d8b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86252024-11-14T09:08:55.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
86262024-11-14T09:08:55.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
86272024-11-14T09:08:55.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86282024-11-14T09:08:55.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86292024-11-14T09:08:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86302024-11-14T09:08:55.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86312024-11-14T09:08:55.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86322024-11-14T09:08:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86332024-11-14T09:08:55.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86342024-11-14T09:08:55.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86352024-11-14T09:08:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86362024-11-14T09:08:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86372024-11-14T09:08:55.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86382024-11-14T09:08:55.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
86392024-11-14T09:08:55.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86402024-11-14T09:08:55.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86412024-11-14T09:08:55.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
86422024-11-14T09:08:55.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.112801ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
86432024-11-14T09:08:55.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86442024-11-14T09:08:55.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86452024-11-14T09:08:55.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.13978ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86462024-11-14T09:08:56.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 10f71882-8fc6-4112-8899-2c77efdd8813 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86472024-11-14T09:08:56.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 10f71882-8fc6-4112-8899-2c77efdd8813 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86482024-11-14T09:08:56.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 10f71882-8fc6-4112-8899-2c77efdd8813 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86492024-11-14T09:08:57.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b88c44ac-5f8b-427b-a55c-362ff3a78af5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86502024-11-14T09:08:57.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b88c44ac-5f8b-427b-a55c-362ff3a78af5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86512024-11-14T09:08:57.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b88c44ac-5f8b-427b-a55c-362ff3a78af5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86522024-11-14T09:08:58.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c86e45d0-2555-4deb-a13f-f5ad3ace7ed6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86532024-11-14T09:08:58.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c86e45d0-2555-4deb-a13f-f5ad3ace7ed6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86542024-11-14T09:08:58.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c86e45d0-2555-4deb-a13f-f5ad3ace7ed6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86552024-11-14T09:08:59.050ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1420 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 03582923-f9f2-46f3-92a8-07b332a6a2ab response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
86562024-11-14T09:08:59.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a5d0c6e-e8b4-46b3-b86f-6b8905c44faa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86572024-11-14T09:08:59.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a5d0c6e-e8b4-46b3-b86f-6b8905c44faa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86582024-11-14T09:08:59.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3a5d0c6e-e8b4-46b3-b86f-6b8905c44faa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86592024-11-14T09:09:00.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a23a5974-6faf-4613-965d-949b084443d3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86602024-11-14T09:09:00.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a23a5974-6faf-4613-965d-949b084443d3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86612024-11-14T09:09:00.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a23a5974-6faf-4613-965d-949b084443d3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86622024-11-14T09:09:01.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3572ccab-afda-47dd-8353-df22bdb4a703 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86632024-11-14T09:09:01.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3572ccab-afda-47dd-8353-df22bdb4a703 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86642024-11-14T09:09:01.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3572ccab-afda-47dd-8353-df22bdb4a703 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86652024-11-14T09:09:02.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a1bcef6-5cc1-4d78-bd9c-306745f882b7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86662024-11-14T09:09:02.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a1bcef6-5cc1-4d78-bd9c-306745f882b7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86672024-11-14T09:09:02.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a1bcef6-5cc1-4d78-bd9c-306745f882b7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86682024-11-14T09:09:03.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c2ab436c-d1da-4256-88c0-ba8ea537648a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86692024-11-14T09:09:03.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c2ab436c-d1da-4256-88c0-ba8ea537648a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86702024-11-14T09:09:03.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c2ab436c-d1da-4256-88c0-ba8ea537648a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86712024-11-14T09:09:04.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 1c3cf784-41d3-4c4d-8c0a-8aaaebf30ed2 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
86722024-11-14T09:09:04.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 1c3cf784-41d3-4c4d-8c0a-8aaaebf30ed2 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
86732024-11-14T09:09:04.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 1c3cf784-41d3-4c4d-8c0a-8aaaebf30ed2 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
86742024-11-14T09:09:04.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = a797a5a4-6db3-451d-b0ff-d9328c38a420 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
86752024-11-14T09:09:04.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = a797a5a4-6db3-451d-b0ff-d9328c38a420 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
86762024-11-14T09:09:04.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = a797a5a4-6db3-451d-b0ff-d9328c38a420 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
86772024-11-14T09:09:04.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ffe8b1a-1e48-4df4-bac0-9c11c74067aa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86782024-11-14T09:09:04.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ffe8b1a-1e48-4df4-bac0-9c11c74067aa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86792024-11-14T09:09:04.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ffe8b1a-1e48-4df4-bac0-9c11c74067aa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
86802024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
86812024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86822024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
86832024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
86842024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
86852024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
86862024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
86872024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86882024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86892024-11-14T09:09:05.533ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86902024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86912024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
86922024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86932024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
86942024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
86952024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86962024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86972024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
86982024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86992024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87002024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
87012024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87022024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
87032024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
87042024-11-14T09:09:05.533ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 08:59:05.533711682 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87052024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87062024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
87072024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87082024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
87092024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87102024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
87112024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87122024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
87132024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87142024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87152024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
87162024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
87172024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
87182024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87192024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87202024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
87212024-11-14T09:09:05.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
87222024-11-14T09:09:05.533ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
87232024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87242024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
87252024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.3\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
87262024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87272024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
87282024-11-14T09:09:05.534ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87292024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87302024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
87312024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87322024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
87332024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87342024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
87352024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87362024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
87372024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87382024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
87392024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87402024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
87412024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87422024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87432024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87442024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87452024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87462024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87472024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87482024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87492024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87502024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87512024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87522024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87532024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87542024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87552024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87562024-11-14T09:09:05.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 319285982 } })
87572024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87582024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87592024-11-14T09:09:05.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 319335143 } })
87602024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87612024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87622024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87632024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87642024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87652024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87662024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87672024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87682024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
87692024-11-14T09:09:05.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.115238ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
87702024-11-14T09:09:05.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
87712024-11-14T09:09:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.386822ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
87722024-11-14T09:09:05.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87732024-11-14T09:09:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87742024-11-14T09:09:05.538ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87752024-11-14T09:09:05.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87762024-11-14T09:09:05.538ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.460928ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87772024-11-14T09:09:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87782024-11-14T09:09:05.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87792024-11-14T09:09:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87802024-11-14T09:09:05.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87812024-11-14T09:09:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87822024-11-14T09:09:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87832024-11-14T09:09:05.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 329953363 } })
87842024-11-14T09:09:05.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
87852024-11-14T09:09:05.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87862024-11-14T09:09:05.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87872024-11-14T09:09:05.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87882024-11-14T09:09:05.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87892024-11-14T09:09:05.550ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 08:59:05.533711682 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87902024-11-14T09:09:05.550ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.963143ms iteration = 12 status = {"expiration":"2024-11-14T08:59:05.533711682Z","pruned":[]}
87912024-11-14T09:09:05.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 336505428 } })
87922024-11-14T09:09:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87932024-11-14T09:09:05.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87942024-11-14T09:09:05.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
87952024-11-14T09:09:05.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87962024-11-14T09:09:05.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87972024-11-14T09:09:05.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87982024-11-14T09:09:05.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87992024-11-14T09:09:05.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88002024-11-14T09:09:05.555ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88012024-11-14T09:09:05.555ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88022024-11-14T09:09:05.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88032024-11-14T09:09:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88042024-11-14T09:09:05.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052024-11-14T09:09:05.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88062024-11-14T09:09:05.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88072024-11-14T09:09:05.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88082024-11-14T09:09:05.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88092024-11-14T09:09:05.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88102024-11-14T09:09:05.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88112024-11-14T09:09:05.561ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.656924ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
88122024-11-14T09:09:05.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88132024-11-14T09:09:05.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88142024-11-14T09:09:05.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 348911478 } })
88152024-11-14T09:09:05.564ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
88162024-11-14T09:09:05.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88172024-11-14T09:09:05.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88182024-11-14T09:09:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88192024-11-14T09:09:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88202024-11-14T09:09:05.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88212024-11-14T09:09:05.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88222024-11-14T09:09:05.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88232024-11-14T09:09:05.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88242024-11-14T09:09:05.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88252024-11-14T09:09:05.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88262024-11-14T09:09:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88272024-11-14T09:09:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88282024-11-14T09:09:05.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88292024-11-14T09:09:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88302024-11-14T09:09:05.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312024-11-14T09:09:05.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88322024-11-14T09:09:05.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88332024-11-14T09:09:05.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88342024-11-14T09:09:05.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88352024-11-14T09:09:05.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88362024-11-14T09:09:05.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88372024-11-14T09:09:05.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88382024-11-14T09:09:05.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88392024-11-14T09:09:05.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88402024-11-14T09:09:05.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88412024-11-14T09:09:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88422024-11-14T09:09:05.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88432024-11-14T09:09:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88442024-11-14T09:09:05.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88452024-11-14T09:09:05.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88462024-11-14T09:09:05.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88472024-11-14T09:09:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88482024-11-14T09:09:05.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88492024-11-14T09:09:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88502024-11-14T09:09:05.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88512024-11-14T09:09:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88522024-11-14T09:09:05.611ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88532024-11-14T09:09:05.611ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88542024-11-14T09:09:05.611ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.238887ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88552024-11-14T09:09:05.614ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88562024-11-14T09:09:05.614ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88572024-11-14T09:09:05.614ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.665446ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88582024-11-14T09:09:05.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.589536ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
88592024-11-14T09:09:05.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88602024-11-14T09:09:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88612024-11-14T09:09:05.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.498758ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
88622024-11-14T09:09:05.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88632024-11-14T09:09:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88642024-11-14T09:09:05.621ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88652024-11-14T09:09:05.621ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88662024-11-14T09:09:05.621ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88672024-11-14T09:09:05.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88682024-11-14T09:09:05.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88692024-11-14T09:09:05.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88702024-11-14T09:09:05.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.922424ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88712024-11-14T09:09:05.630ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88722024-11-14T09:09:05.630ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88732024-11-14T09:09:05.630ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88742024-11-14T09:09:05.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88752024-11-14T09:09:05.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88762024-11-14T09:09:05.635ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88772024-11-14T09:09:05.635ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88782024-11-14T09:09:05.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88792024-11-14T09:09:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88802024-11-14T09:09:05.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88812024-11-14T09:09:05.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88822024-11-14T09:09:05.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5db717b6-231d-4b7a-99a4-b43ed8284460 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
88832024-11-14T09:09:05.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5db717b6-231d-4b7a-99a4-b43ed8284460 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
88842024-11-14T09:09:05.726ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.853428ms iteration = 27 status = {"physical_disks_added":0}
88852024-11-14T09:09:05.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
88862024-11-14T09:09:05.740ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88872024-11-14T09:09:05.741ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5b3adc9-5c97-416f-91e0-891da84589cb", "content-length": "26", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
88882024-11-14T09:09:05.741ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88892024-11-14T09:09:05.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88902024-11-14T09:09:05.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
88912024-11-14T09:09:05.745ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88922024-11-14T09:09:05.745ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f043fc1-d420-4ff1-9ffc-28403b8b4da3", "content-length": "26", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
88932024-11-14T09:09:05.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88942024-11-14T09:09:05.746ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
88952024-11-14T09:09:05.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 4bbe512e-1c7c-48c1-b5af-047335213b41 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
88962024-11-14T09:09:05.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 4bbe512e-1c7c-48c1-b5af-047335213b41 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
88972024-11-14T09:09:05.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
88982024-11-14T09:09:05.841ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88992024-11-14T09:09:05.841ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c7eecbe-5725-4155-b11f-61c4fd69cbd8", "content-length": "26", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
89002024-11-14T09:09:05.842ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89012024-11-14T09:09:05.844ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89022024-11-14T09:09:05.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89032024-11-14T09:09:05.858ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89042024-11-14T09:09:05.904ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 371.066231ms iteration = 23 status = {}
89052024-11-14T09:09:05.921ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89062024-11-14T09:09:05.921ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89072024-11-14T09:09:05.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a67cc7de-ccc3-45b4-931b-80797d2d8a50", "content-length": "372", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
89082024-11-14T09:09:05.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89092024-11-14T09:09:05.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89102024-11-14T09:09:05.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89112024-11-14T09:09:05.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89122024-11-14T09:09:05.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5db717b6-231d-4b7a-99a4-b43ed8284460 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
89132024-11-14T09:09:05.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 4bbe512e-1c7c-48c1-b5af-047335213b41 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
89142024-11-14T09:09:05.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89152024-11-14T09:09:05.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89162024-11-14T09:09:05.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89172024-11-14T09:09:05.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89182024-11-14T09:09:05.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89192024-11-14T09:09:05.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89202024-11-14T09:09:05.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89212024-11-14T09:09:05.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89222024-11-14T09:09:05.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89232024-11-14T09:09:05.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
89242024-11-14T09:09:05.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89252024-11-14T09:09:05.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89262024-11-14T09:09:05.966ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89272024-11-14T09:09:05.966ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89282024-11-14T09:09:05.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 433.117719ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89292024-11-14T09:09:05.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89302024-11-14T09:09:05.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89312024-11-14T09:09:05.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 437.236055ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89322024-11-14T09:09:05.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89332024-11-14T09:09:05.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89342024-11-14T09:09:05.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 439.964229ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89352024-11-14T09:09:05.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89362024-11-14T09:09:05.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89372024-11-14T09:09:05.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89382024-11-14T09:09:05.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 441.979021ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89392024-11-14T09:09:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89402024-11-14T09:09:05.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89412024-11-14T09:09:05.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89422024-11-14T09:09:05.979ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
89432024-11-14T09:09:05.979ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 445.491687ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
89442024-11-14T09:09:05.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 446.049287ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89452024-11-14T09:09:05.984ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89462024-11-14T09:09:05.984ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89472024-11-14T09:09:05.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d66e537-f2c4-422a-a69c-8902080eedc3", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
89482024-11-14T09:09:05.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89492024-11-14T09:09:05.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89502024-11-14T09:09:05.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89512024-11-14T09:09:05.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89522024-11-14T09:09:05.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89532024-11-14T09:09:05.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89542024-11-14T09:09:05.996ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89552024-11-14T09:09:05.998ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89562024-11-14T09:09:05.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89572024-11-14T09:09:05.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
89582024-11-14T09:09:05.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89592024-11-14T09:09:06.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89602024-11-14T09:09:06.002ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 468.837042ms iteration = 23 status = 0
89612024-11-14T09:09:06.005ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89622024-11-14T09:09:06.005ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
89632024-11-14T09:09:06.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89642024-11-14T09:09:06.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89652024-11-14T09:09:06.005ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62d17dfb-412e-4779-b6d1-bc79c532c028", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
89662024-11-14T09:09:06.008ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 474.456703ms iteration = 24 status = {}
89672024-11-14T09:09:06.012ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89682024-11-14T09:09:06.012ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89692024-11-14T09:09:06.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89702024-11-14T09:09:06.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89712024-11-14T09:09:06.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89722024-11-14T09:09:06.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89732024-11-14T09:09:06.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89742024-11-14T09:09:06.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89752024-11-14T09:09:06.019ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
89762024-11-14T09:09:06.019ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 485.681963ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89772024-11-14T09:09:06.022ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
89782024-11-14T09:09:06.022ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89792024-11-14T09:09:06.022ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
89802024-11-14T09:09:06.022ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 488.409157ms iteration = 13 status = {"generation":1}
89812024-11-14T09:09:06.031ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89822024-11-14T09:09:06.031ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e08a5b2-1067-49cd-ae6b-aa65edda7a5c", "content-length": "1", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
89832024-11-14T09:09:06.033ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89842024-11-14T09:09:06.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89852024-11-14T09:09:06.039ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 505.940409ms iteration = 23 status = null
89862024-11-14T09:09:06.040ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89872024-11-14T09:09:06.040ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 506.186952ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89882024-11-14T09:09:06.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89892024-11-14T09:09:06.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89902024-11-14T09:09:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89912024-11-14T09:09:06.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89922024-11-14T09:09:06.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89932024-11-14T09:09:06.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89942024-11-14T09:09:06.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89952024-11-14T09:09:06.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89962024-11-14T09:09:06.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89972024-11-14T09:09:06.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89982024-11-14T09:09:06.052ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
89992024-11-14T09:09:06.052ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90002024-11-14T09:09:06.052ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
90012024-11-14T09:09:06.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 518.848066ms iteration = 13 status = {"generation":2}
90022024-11-14T09:09:06.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032024-11-14T09:09:06.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90042024-11-14T09:09:06.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90052024-11-14T09:09:06.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90062024-11-14T09:09:06.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90072024-11-14T09:09:06.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90082024-11-14T09:09:06.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5e678fda-5e55-4eae-8d2c-6258bdd5149d", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90092024-11-14T09:09:06.138ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90102024-11-14T09:09:06.140ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "af977841-2981-4996-bbfc-abe82126a065", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90112024-11-14T09:09:06.140ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90122024-11-14T09:09:06.142ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90132024-11-14T09:09:06.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 608.541827ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90142024-11-14T09:09:06.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90152024-11-14T09:09:06.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90162024-11-14T09:09:06.158ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
90172024-11-14T09:09:06.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90182024-11-14T09:09:06.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90192024-11-14T09:09:06.168ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90202024-11-14T09:09:06.168ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d5fbe7-ad25-4fd4-9de0-b5cc927618f2", "content-length": "134", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
90212024-11-14T09:09:06.168ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90222024-11-14T09:09:06.168ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
90232024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90242024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90252024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90262024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90272024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90282024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90292024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90302024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90312024-11-14T09:09:06.169ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
90322024-11-14T09:09:06.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90332024-11-14T09:09:06.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90342024-11-14T09:09:06.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90352024-11-14T09:09:06.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7754ba6b-7ee3-4246-bfef-bc3933d29be5", "content-length": "2", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
90362024-11-14T09:09:06.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90372024-11-14T09:09:06.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0982a843-d766-45a5-83fb-4b4a2774220d", "content-length": "52", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
90382024-11-14T09:09:06.171ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
90392024-11-14T09:09:06.171ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90402024-11-14T09:09:06.177ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90412024-11-14T09:09:06.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90422024-11-14T09:09:06.184ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0d6efa28-3438-49d8-a34c-6c340fb00884", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90432024-11-14T09:09:06.184ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90442024-11-14T09:09:06.186ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "72579ea6-c06e-4774-bc0d-1675d6167cd8", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90452024-11-14T09:09:06.186ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90462024-11-14T09:09:06.187ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a8387d76-d6a6-470a-84fb-ccaa558cdadb", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90472024-11-14T09:09:06.187ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90482024-11-14T09:09:06.189ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90492024-11-14T09:09:06.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 655.618423ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90502024-11-14T09:09:06.283ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "74dd85ec-d3c0-4fe4-be12-8a5b57be4ca3", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
90512024-11-14T09:09:06.283ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
90522024-11-14T09:09:06.283ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90532024-11-14T09:09:06.283ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee46fc45-fd92-4a2d-951b-690508077229", "content-length": "682", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
90542024-11-14T09:09:06.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90552024-11-14T09:09:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90562024-11-14T09:09:06.283ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bea51be7-6fe6-48d2-80b7-a13dfc2c8c23", "content-length": "691", "date": "Thu, 14 Nov 2024 09:09:05 GMT"} })
90572024-11-14T09:09:06.283ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90582024-11-14T09:09:06.283ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90592024-11-14T09:09:06.283ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90602024-11-14T09:09:06.286ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 752.429308ms iteration = 23 status = {}
90612024-11-14T09:09:06.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90622024-11-14T09:09:06.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90632024-11-14T09:09:06.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90642024-11-14T09:09:06.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90652024-11-14T09:09:06.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90662024-11-14T09:09:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90672024-11-14T09:09:06.300ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 766.737078ms iteration = 23 status = {}
90682024-11-14T09:09:06.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bb2b05b-bbb9-49a8-9014-5545e41580b2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90692024-11-14T09:09:06.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bb2b05b-bbb9-49a8-9014-5545e41580b2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90702024-11-14T09:09:06.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bb2b05b-bbb9-49a8-9014-5545e41580b2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90712024-11-14T09:09:07.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 427f2e65-3f5d-4cff-af32-b34cb9b27b5e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90722024-11-14T09:09:07.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 427f2e65-3f5d-4cff-af32-b34cb9b27b5e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90732024-11-14T09:09:07.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 427f2e65-3f5d-4cff-af32-b34cb9b27b5e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90742024-11-14T09:09:09.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 882ed105-647c-43b3-a493-638ad0962184 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90752024-11-14T09:09:09.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 882ed105-647c-43b3-a493-638ad0962184 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90762024-11-14T09:09:09.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 882ed105-647c-43b3-a493-638ad0962184 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90772024-11-14T09:09:10.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8561205-7a5f-45d5-bace-4b9dbaf4d74f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90782024-11-14T09:09:10.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8561205-7a5f-45d5-bace-4b9dbaf4d74f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90792024-11-14T09:09:10.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8561205-7a5f-45d5-bace-4b9dbaf4d74f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90802024-11-14T09:09:11.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0e73bf81-b6cc-40ee-addb-d9832455dc20 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90812024-11-14T09:09:11.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0e73bf81-b6cc-40ee-addb-d9832455dc20 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90822024-11-14T09:09:11.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0e73bf81-b6cc-40ee-addb-d9832455dc20 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90832024-11-14T09:09:12.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1bd68542-64d8-4f23-8c69-50959853d02e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90842024-11-14T09:09:12.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1bd68542-64d8-4f23-8c69-50959853d02e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90852024-11-14T09:09:12.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1bd68542-64d8-4f23-8c69-50959853d02e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90862024-11-14T09:09:13.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63d227b5-1615-4055-9056-50848ccd7850 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90872024-11-14T09:09:13.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63d227b5-1615-4055-9056-50848ccd7850 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90882024-11-14T09:09:13.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 63d227b5-1615-4055-9056-50848ccd7850 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90892024-11-14T09:09:14.050ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = c7669cc7-e319-453b-99a2-754be70e4bda response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
90902024-11-14T09:09:14.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 67c0e702-0c1e-41d9-beb4-cd7536648e0d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90912024-11-14T09:09:14.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 67c0e702-0c1e-41d9-beb4-cd7536648e0d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90922024-11-14T09:09:14.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 67c0e702-0c1e-41d9-beb4-cd7536648e0d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90932024-11-14T09:09:15.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d2870acb-fa7b-45c3-bb97-526abfee6f17 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90942024-11-14T09:09:15.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d2870acb-fa7b-45c3-bb97-526abfee6f17 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90952024-11-14T09:09:15.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d2870acb-fa7b-45c3-bb97-526abfee6f17 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
90962024-11-14T09:09:15.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
90972024-11-14T09:09:15.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
90982024-11-14T09:09:15.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90992024-11-14T09:09:15.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91002024-11-14T09:09:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91012024-11-14T09:09:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91022024-11-14T09:09:15.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91032024-11-14T09:09:15.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91042024-11-14T09:09:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91052024-11-14T09:09:15.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.879552ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91062024-11-14T09:09:15.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91072024-11-14T09:09:15.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91082024-11-14T09:09:15.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91092024-11-14T09:09:15.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91102024-11-14T09:09:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91112024-11-14T09:09:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91122024-11-14T09:09:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
91132024-11-14T09:09:15.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91142024-11-14T09:09:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91152024-11-14T09:09:15.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
91162024-11-14T09:09:15.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.593054ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
91172024-11-14T09:09:16.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 782daec1-4d6e-4526-8625-118a9e2064f3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91182024-11-14T09:09:16.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 782daec1-4d6e-4526-8625-118a9e2064f3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91192024-11-14T09:09:16.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 782daec1-4d6e-4526-8625-118a9e2064f3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91202024-11-14T09:09:17.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1451c393-fc5b-428a-b751-3c2230ebe3fe roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91212024-11-14T09:09:17.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1451c393-fc5b-428a-b751-3c2230ebe3fe resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91222024-11-14T09:09:17.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1451c393-fc5b-428a-b751-3c2230ebe3fe response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91232024-11-14T09:09:18.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 378d7647-ec43-40e3-8f10-6101ff04fe13 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91242024-11-14T09:09:18.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 378d7647-ec43-40e3-8f10-6101ff04fe13 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91252024-11-14T09:09:18.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 378d7647-ec43-40e3-8f10-6101ff04fe13 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91262024-11-14T09:09:19.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d7669bf9-9e7e-4c9b-b94b-a14120fc29f8 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
91272024-11-14T09:09:19.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d7669bf9-9e7e-4c9b-b94b-a14120fc29f8 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
91282024-11-14T09:09:19.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d7669bf9-9e7e-4c9b-b94b-a14120fc29f8 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
91292024-11-14T09:09:19.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 0577fdeb-fbd1-4cb9-b8b3-cd2bb208705f roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
91302024-11-14T09:09:19.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 0577fdeb-fbd1-4cb9-b8b3-cd2bb208705f resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
91312024-11-14T09:09:19.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 0577fdeb-fbd1-4cb9-b8b3-cd2bb208705f response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
91322024-11-14T09:09:19.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e888a4ea-11d1-47dd-bb64-c69671cbabc6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91332024-11-14T09:09:19.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e888a4ea-11d1-47dd-bb64-c69671cbabc6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91342024-11-14T09:09:19.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e888a4ea-11d1-47dd-bb64-c69671cbabc6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91352024-11-14T09:09:20.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1505507-477a-4cdb-9212-2ec14a7d5ff2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91362024-11-14T09:09:20.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1505507-477a-4cdb-9212-2ec14a7d5ff2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91372024-11-14T09:09:20.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1505507-477a-4cdb-9212-2ec14a7d5ff2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91382024-11-14T09:09:21.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e4270e2-9f70-4f56-97ff-6673608a30f2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91392024-11-14T09:09:21.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e4270e2-9f70-4f56-97ff-6673608a30f2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91402024-11-14T09:09:21.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e4270e2-9f70-4f56-97ff-6673608a30f2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91412024-11-14T09:09:22.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5a5bbf3a-04ea-497b-b8d8-024ed4c79ba4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91422024-11-14T09:09:22.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5a5bbf3a-04ea-497b-b8d8-024ed4c79ba4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91432024-11-14T09:09:22.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5a5bbf3a-04ea-497b-b8d8-024ed4c79ba4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91442024-11-14T09:09:23.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7796b29a-620b-41a1-b0c0-5111558c5664 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91452024-11-14T09:09:23.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7796b29a-620b-41a1-b0c0-5111558c5664 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91462024-11-14T09:09:23.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7796b29a-620b-41a1-b0c0-5111558c5664 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91472024-11-14T09:09:24.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c63d15ae-9051-4e3d-b591-142375ccefde roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91482024-11-14T09:09:24.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c63d15ae-9051-4e3d-b591-142375ccefde resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91492024-11-14T09:09:24.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c63d15ae-9051-4e3d-b591-142375ccefde response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91502024-11-14T09:09:25.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 609d3b86-89c0-4fc6-b626-144d81aea281 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91512024-11-14T09:09:25.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 609d3b86-89c0-4fc6-b626-144d81aea281 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91522024-11-14T09:09:25.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 609d3b86-89c0-4fc6-b626-144d81aea281 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91532024-11-14T09:09:25.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
91542024-11-14T09:09:25.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91552024-11-14T09:09:25.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
91562024-11-14T09:09:25.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91572024-11-14T09:09:25.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91582024-11-14T09:09:25.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91592024-11-14T09:09:25.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91602024-11-14T09:09:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91612024-11-14T09:09:25.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91622024-11-14T09:09:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91632024-11-14T09:09:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91642024-11-14T09:09:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91652024-11-14T09:09:25.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91662024-11-14T09:09:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91672024-11-14T09:09:25.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91682024-11-14T09:09:25.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
91692024-11-14T09:09:25.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91702024-11-14T09:09:25.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91712024-11-14T09:09:25.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
91722024-11-14T09:09:25.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.777294ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
91732024-11-14T09:09:25.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.976903ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91742024-11-14T09:09:26.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be8c41f8-4156-495f-905c-82658da235ab roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91752024-11-14T09:09:26.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be8c41f8-4156-495f-905c-82658da235ab resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91762024-11-14T09:09:26.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be8c41f8-4156-495f-905c-82658da235ab response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91772024-11-14T09:09:27.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b2ef43a4-c8d6-4451-8002-f2f7cba709a9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91782024-11-14T09:09:27.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b2ef43a4-c8d6-4451-8002-f2f7cba709a9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91792024-11-14T09:09:27.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b2ef43a4-c8d6-4451-8002-f2f7cba709a9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91802024-11-14T09:09:28.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 269766b6-b57a-4b4c-a2ae-d1c405d418d7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91812024-11-14T09:09:28.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 269766b6-b57a-4b4c-a2ae-d1c405d418d7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91822024-11-14T09:09:28.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 269766b6-b57a-4b4c-a2ae-d1c405d418d7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91832024-11-14T09:09:29.051ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 281a7ec2-301a-48d4-9845-33df4503a68d response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
91842024-11-14T09:09:29.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 341910b8-c6f7-4fa8-bf70-35cb1001be0e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91852024-11-14T09:09:29.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 341910b8-c6f7-4fa8-bf70-35cb1001be0e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91862024-11-14T09:09:29.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 341910b8-c6f7-4fa8-bf70-35cb1001be0e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91872024-11-14T09:09:30.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74d597fd-5005-4a96-8a3e-4a447e98ab48 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91882024-11-14T09:09:30.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74d597fd-5005-4a96-8a3e-4a447e98ab48 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91892024-11-14T09:09:30.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 74d597fd-5005-4a96-8a3e-4a447e98ab48 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91902024-11-14T09:09:31.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fb7dd486-2ef5-4452-858e-f6e2d14fc7ba roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91912024-11-14T09:09:31.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fb7dd486-2ef5-4452-858e-f6e2d14fc7ba resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91922024-11-14T09:09:31.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fb7dd486-2ef5-4452-858e-f6e2d14fc7ba response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91932024-11-14T09:09:32.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d9caf176-7702-42f2-9b64-07a27ec6f809 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91942024-11-14T09:09:32.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d9caf176-7702-42f2-9b64-07a27ec6f809 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91952024-11-14T09:09:32.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d9caf176-7702-42f2-9b64-07a27ec6f809 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91962024-11-14T09:09:33.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e09002a8-5189-41d1-921c-f395479ac9b4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91972024-11-14T09:09:33.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e09002a8-5189-41d1-921c-f395479ac9b4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91982024-11-14T09:09:33.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e09002a8-5189-41d1-921c-f395479ac9b4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
91992024-11-14T09:09:34.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 74eafe1d-4bfb-409b-8cb9-2fafb9bea70e roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
92002024-11-14T09:09:34.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 74eafe1d-4bfb-409b-8cb9-2fafb9bea70e resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
92012024-11-14T09:09:34.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 74eafe1d-4bfb-409b-8cb9-2fafb9bea70e response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
92022024-11-14T09:09:34.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 7c06b547-acda-47b5-905e-5a63c5eefecf roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
92032024-11-14T09:09:34.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 7c06b547-acda-47b5-905e-5a63c5eefecf resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
92042024-11-14T09:09:34.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 7c06b547-acda-47b5-905e-5a63c5eefecf response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
92052024-11-14T09:09:34.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0d11773-e7c7-431d-862f-47222283473e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
92062024-11-14T09:09:34.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0d11773-e7c7-431d-862f-47222283473e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
92072024-11-14T09:09:34.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0d11773-e7c7-431d-862f-47222283473e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
92082024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
92092024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92102024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
92112024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
92122024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92132024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
92142024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
92152024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
92162024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92172024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92182024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92192024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92202024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
92212024-11-14T09:09:35.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92222024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
92232024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92242024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
92252024-11-14T09:09:35.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92262024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
92272024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92282024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92292024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
92302024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92312024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
92322024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92332024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
92342024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92352024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
92362024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92372024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
92382024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92392024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
92402024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92412024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
92422024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92432024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92442024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92452024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92462024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92472024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92482024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92492024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92502024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92512024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92522024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92532024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92542024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92552024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92562024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92572024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92582024-11-14T09:09:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92592024-11-14T09:09:35.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92602024-11-14T09:09:35.538ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.921009ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92612024-11-14T09:09:35.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 323378838 } })
92622024-11-14T09:09:35.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
92632024-11-14T09:09:35.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642024-11-14T09:09:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92652024-11-14T09:09:35.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92662024-11-14T09:09:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92672024-11-14T09:09:35.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92682024-11-14T09:09:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92692024-11-14T09:09:35.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92702024-11-14T09:09:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92712024-11-14T09:09:35.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92722024-11-14T09:09:35.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92732024-11-14T09:09:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92742024-11-14T09:09:35.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 334990684 } })
92752024-11-14T09:09:35.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
92762024-11-14T09:09:35.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92772024-11-14T09:09:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92782024-11-14T09:09:35.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92792024-11-14T09:09:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92802024-11-14T09:09:35.554ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 338614682 } })
92812024-11-14T09:09:35.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
92822024-11-14T09:09:35.571ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92832024-11-14T09:09:35.571ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92842024-11-14T09:09:35.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92852024-11-14T09:09:35.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92862024-11-14T09:09:35.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92872024-11-14T09:09:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92882024-11-14T09:09:35.593ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92892024-11-14T09:09:35.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92902024-11-14T09:09:35.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92912024-11-14T09:09:35.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92922024-11-14T09:09:35.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92932024-11-14T09:09:35.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92942024-11-14T09:09:35.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92952024-11-14T09:09:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92962024-11-14T09:09:35.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92972024-11-14T09:09:35.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.422237ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
92982024-11-14T09:09:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92992024-11-14T09:09:35.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93002024-11-14T09:09:35.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93012024-11-14T09:09:35.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93022024-11-14T09:09:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93032024-11-14T09:09:35.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93042024-11-14T09:09:35.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93052024-11-14T09:09:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93062024-11-14T09:09:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93072024-11-14T09:09:35.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93082024-11-14T09:09:35.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.810552ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
93092024-11-14T09:09:35.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93102024-11-14T09:09:35.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93112024-11-14T09:09:35.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93122024-11-14T09:09:35.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93132024-11-14T09:09:35.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93142024-11-14T09:09:35.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93152024-11-14T09:09:35.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.996385ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93162024-11-14T09:09:35.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
93172024-11-14T09:09:35.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93182024-11-14T09:09:35.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93192024-11-14T09:09:35.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93202024-11-14T09:09:35.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93212024-11-14T09:09:35.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93222024-11-14T09:09:35.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93232024-11-14T09:09:35.617ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93242024-11-14T09:09:35.617ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93252024-11-14T09:09:35.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93262024-11-14T09:09:35.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93272024-11-14T09:09:35.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
93282024-11-14T09:09:35.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.649137ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
93292024-11-14T09:09:35.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93302024-11-14T09:09:35.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93312024-11-14T09:09:35.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93322024-11-14T09:09:35.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93332024-11-14T09:09:35.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.027611ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93342024-11-14T09:09:35.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.65757ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93352024-11-14T09:09:35.656ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93362024-11-14T09:09:35.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.63772ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93372024-11-14T09:09:35.657ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93382024-11-14T09:09:35.658ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93392024-11-14T09:09:35.658ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.135354ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93402024-11-14T09:09:35.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93412024-11-14T09:09:35.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93422024-11-14T09:09:35.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
93432024-11-14T09:09:35.671ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93442024-11-14T09:09:35.671ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dc8bd56-5655-4cc0-9eac-129719f26bcf", "content-length": "26", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93452024-11-14T09:09:35.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93462024-11-14T09:09:35.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.777514ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93472024-11-14T09:09:35.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93482024-11-14T09:09:35.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
93492024-11-14T09:09:35.675ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93502024-11-14T09:09:35.675ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd5aec6c-3c1f-4eef-aa7b-9ee9da646c63", "content-length": "26", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93512024-11-14T09:09:35.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93522024-11-14T09:09:35.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93532024-11-14T09:09:35.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
93542024-11-14T09:09:35.745ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93552024-11-14T09:09:35.745ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "842ed8f5-5cb8-40b6-bc3f-22f0905901a6", "content-length": "26", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93562024-11-14T09:09:35.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93572024-11-14T09:09:35.746ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.433563ms iteration = 28 status = {"physical_disks_added":0}
93582024-11-14T09:09:35.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
93592024-11-14T09:09:35.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fe8cbc67-10ed-4d93-827c-a4b27ce2b473 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
93602024-11-14T09:09:35.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fe8cbc67-10ed-4d93-827c-a4b27ce2b473 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
93612024-11-14T09:09:35.761ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93622024-11-14T09:09:35.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93632024-11-14T09:09:35.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fe8cbc67-10ed-4d93-827c-a4b27ce2b473 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
93642024-11-14T09:09:35.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93652024-11-14T09:09:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93662024-11-14T09:09:35.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93672024-11-14T09:09:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
93682024-11-14T09:09:35.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93692024-11-14T09:09:35.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93702024-11-14T09:09:35.772ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 238.470401ms iteration = 24 status = 0
93712024-11-14T09:09:35.775ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5864698-1ee1-47ab-976c-2ac36dea484d", "content-length": "372", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93722024-11-14T09:09:35.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93732024-11-14T09:09:35.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93742024-11-14T09:09:35.805ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93752024-11-14T09:09:35.805ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "516b53f0-b1c9-423e-90eb-d20c56889c56", "content-length": "1", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93762024-11-14T09:09:35.807ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93772024-11-14T09:09:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93782024-11-14T09:09:35.809ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 275.992135ms iteration = 24 status = null
93792024-11-14T09:09:35.811ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 277.656301ms iteration = 24 status = {}
93802024-11-14T09:09:35.829ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93812024-11-14T09:09:35.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93822024-11-14T09:09:35.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3b9fd2c6-b682-46d3-a88c-5b26b35bcb3f", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93832024-11-14T09:09:35.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93842024-11-14T09:09:35.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93852024-11-14T09:09:35.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93862024-11-14T09:09:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93872024-11-14T09:09:35.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93882024-11-14T09:09:35.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93892024-11-14T09:09:35.839ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93902024-11-14T09:09:35.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93912024-11-14T09:09:35.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4f756f9f-e06c-4d08-a031-bfe474140dc1", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
93922024-11-14T09:09:35.845ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 311.710398ms iteration = 25 status = {}
93932024-11-14T09:09:35.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93942024-11-14T09:09:35.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93952024-11-14T09:09:35.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962024-11-14T09:09:35.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93972024-11-14T09:09:35.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93982024-11-14T09:09:35.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93992024-11-14T09:09:35.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94002024-11-14T09:09:35.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94012024-11-14T09:09:35.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94022024-11-14T09:09:35.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94032024-11-14T09:09:35.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94042024-11-14T09:09:35.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94052024-11-14T09:09:35.893ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
94062024-11-14T09:09:35.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94072024-11-14T09:09:35.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94082024-11-14T09:09:35.903ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94092024-11-14T09:09:35.904ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a1eedd9-01ff-4e46-b4f9-cb6ee040b303", "content-length": "134", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
94102024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94112024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
94122024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94132024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94142024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94152024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94162024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94172024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94182024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94192024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94202024-11-14T09:09:35.904ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
94212024-11-14T09:09:35.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94222024-11-14T09:09:35.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94232024-11-14T09:09:35.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94242024-11-14T09:09:35.907ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b22d338b-2a86-4a95-81d0-f97dfd1788c4", "content-length": "2", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
94252024-11-14T09:09:35.907ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94262024-11-14T09:09:35.907ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb424c3d-4554-4ac3-9a98-a9613fbced5f", "content-length": "52", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
94272024-11-14T09:09:35.907ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
94282024-11-14T09:09:35.907ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94292024-11-14T09:09:35.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94302024-11-14T09:09:35.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 77c71922-d9c7-4df6-98e4-200e91f5d8d2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
94312024-11-14T09:09:35.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 77c71922-d9c7-4df6-98e4-200e91f5d8d2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
94322024-11-14T09:09:35.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 77c71922-d9c7-4df6-98e4-200e91f5d8d2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
94332024-11-14T09:09:36.002ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "65f6c322-9ab0-43d6-af98-ca36fb03c1b5", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
94342024-11-14T09:09:36.002ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
94352024-11-14T09:09:36.002ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94362024-11-14T09:09:36.002ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85042d61-f0b2-4b5b-ab60-7442643d82b8", "content-length": "691", "date": "Thu, 14 Nov 2024 09:09:35 GMT"} })
94372024-11-14T09:09:36.002ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94382024-11-14T09:09:36.003ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94392024-11-14T09:09:36.003ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94402024-11-14T09:09:36.003ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5403938e-a945-4579-ace7-290f77ee64c2", "content-length": "682", "date": "Thu, 14 Nov 2024 09:09:36 GMT"} })
94412024-11-14T09:09:36.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94422024-11-14T09:09:36.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94432024-11-14T09:09:36.004ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.501279ms iteration = 24 status = {}
94442024-11-14T09:09:36.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94452024-11-14T09:09:36.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94462024-11-14T09:09:36.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94472024-11-14T09:09:36.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94482024-11-14T09:09:36.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94492024-11-14T09:09:36.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94502024-11-14T09:09:36.017ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.899884ms iteration = 24 status = {}
94512024-11-14T09:09:36.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 35bbcb52-3132-4072-95fd-9def73a351ca roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94522024-11-14T09:09:36.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 35bbcb52-3132-4072-95fd-9def73a351ca resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94532024-11-14T09:09:36.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 35bbcb52-3132-4072-95fd-9def73a351ca response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94542024-11-14T09:09:37.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baa2df17-b23a-44cf-92a9-905ed960dd1a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94552024-11-14T09:09:37.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baa2df17-b23a-44cf-92a9-905ed960dd1a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94562024-11-14T09:09:37.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baa2df17-b23a-44cf-92a9-905ed960dd1a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94572024-11-14T09:09:38.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5edb6c9d-6090-4356-bbc2-af0338103b50 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94582024-11-14T09:09:38.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5edb6c9d-6090-4356-bbc2-af0338103b50 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94592024-11-14T09:09:38.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5edb6c9d-6090-4356-bbc2-af0338103b50 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94602024-11-14T09:09:39.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8cd8d9e5-3b47-4fce-8499-08f962ced09f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94612024-11-14T09:09:39.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8cd8d9e5-3b47-4fce-8499-08f962ced09f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94622024-11-14T09:09:39.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8cd8d9e5-3b47-4fce-8499-08f962ced09f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94632024-11-14T09:09:40.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8e669695-1000-4789-8d1d-30aba3ca8356 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94642024-11-14T09:09:40.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8e669695-1000-4789-8d1d-30aba3ca8356 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94652024-11-14T09:09:40.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8e669695-1000-4789-8d1d-30aba3ca8356 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94662024-11-14T09:09:41.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c74101d-91d5-49c2-b9e6-3e9acc452d03 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94672024-11-14T09:09:41.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c74101d-91d5-49c2-b9e6-3e9acc452d03 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94682024-11-14T09:09:41.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c74101d-91d5-49c2-b9e6-3e9acc452d03 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94692024-11-14T09:09:42.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21c56d28-cb29-4c22-83c8-74d482ce7569 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94702024-11-14T09:09:42.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21c56d28-cb29-4c22-83c8-74d482ce7569 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94712024-11-14T09:09:42.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21c56d28-cb29-4c22-83c8-74d482ce7569 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94722024-11-14T09:09:43.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c580b2c3-a812-4357-89db-6ac5217cc30e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94732024-11-14T09:09:43.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c580b2c3-a812-4357-89db-6ac5217cc30e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94742024-11-14T09:09:43.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c580b2c3-a812-4357-89db-6ac5217cc30e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94752024-11-14T09:09:44.052ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1569 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 978f783f-b3d0-44c0-a6fd-bbfb0465f105 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
94762024-11-14T09:09:44.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 409f6f3c-230d-4b14-ab7a-82b7e413fea3 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94772024-11-14T09:09:44.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 409f6f3c-230d-4b14-ab7a-82b7e413fea3 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94782024-11-14T09:09:44.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 409f6f3c-230d-4b14-ab7a-82b7e413fea3 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
94792024-11-14T09:09:45.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
94802024-11-14T09:09:45.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94812024-11-14T09:09:45.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
94822024-11-14T09:09:45.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94832024-11-14T09:09:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94842024-11-14T09:09:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94852024-11-14T09:09:45.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94862024-11-14T09:09:45.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94872024-11-14T09:09:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94882024-11-14T09:09:45.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.008794ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94892024-11-14T09:09:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94902024-11-14T09:09:45.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94912024-11-14T09:09:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94922024-11-14T09:09:45.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94932024-11-14T09:09:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94942024-11-14T09:09:45.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94952024-11-14T09:09:45.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
94962024-11-14T09:09:45.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94972024-11-14T09:09:45.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94982024-11-14T09:09:45.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
94992024-11-14T09:09:45.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.159444ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
95002024-11-14T09:09:46.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7590848e-339e-4977-b8fa-a15d56858570 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95012024-11-14T09:09:46.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7590848e-339e-4977-b8fa-a15d56858570 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95022024-11-14T09:09:46.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7590848e-339e-4977-b8fa-a15d56858570 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95032024-11-14T09:09:47.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0a2b03f1-d97e-4d7c-bf7e-0bef8e7f9187 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95042024-11-14T09:09:47.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0a2b03f1-d97e-4d7c-bf7e-0bef8e7f9187 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95052024-11-14T09:09:47.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0a2b03f1-d97e-4d7c-bf7e-0bef8e7f9187 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95062024-11-14T09:09:48.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c483608-8726-43ed-b187-4beeaa77274c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95072024-11-14T09:09:48.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c483608-8726-43ed-b187-4beeaa77274c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95082024-11-14T09:09:48.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c483608-8726-43ed-b187-4beeaa77274c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95092024-11-14T09:09:49.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d224c8f6-16b6-4df9-b986-b9429c6dd765 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
95102024-11-14T09:09:49.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d224c8f6-16b6-4df9-b986-b9429c6dd765 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
95112024-11-14T09:09:49.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = d224c8f6-16b6-4df9-b986-b9429c6dd765 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
95122024-11-14T09:09:49.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 62e13fd9-da11-4858-830b-33c08edc524b roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
95132024-11-14T09:09:49.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 62e13fd9-da11-4858-830b-33c08edc524b resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
95142024-11-14T09:09:49.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 62e13fd9-da11-4858-830b-33c08edc524b response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
95152024-11-14T09:09:49.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c0032609-6d4b-4ce8-8348-110108106b15 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95162024-11-14T09:09:49.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c0032609-6d4b-4ce8-8348-110108106b15 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95172024-11-14T09:09:49.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c0032609-6d4b-4ce8-8348-110108106b15 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95182024-11-14T09:09:50.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ea24205e-e7d2-4061-ba95-fa933e106f97 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95192024-11-14T09:09:50.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ea24205e-e7d2-4061-ba95-fa933e106f97 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95202024-11-14T09:09:50.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ea24205e-e7d2-4061-ba95-fa933e106f97 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95212024-11-14T09:09:51.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48f89fab-0a8d-4a8b-8284-35ff01ebe8d0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95222024-11-14T09:09:51.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48f89fab-0a8d-4a8b-8284-35ff01ebe8d0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95232024-11-14T09:09:51.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 48f89fab-0a8d-4a8b-8284-35ff01ebe8d0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95242024-11-14T09:09:52.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9d692aac-707a-492a-a916-701a8366df76 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95252024-11-14T09:09:52.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9d692aac-707a-492a-a916-701a8366df76 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95262024-11-14T09:09:52.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9d692aac-707a-492a-a916-701a8366df76 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95272024-11-14T09:09:53.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3dd31ac4-4aa8-4dab-a1dd-edab502a7c86 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95282024-11-14T09:09:53.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3dd31ac4-4aa8-4dab-a1dd-edab502a7c86 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95292024-11-14T09:09:53.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3dd31ac4-4aa8-4dab-a1dd-edab502a7c86 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95302024-11-14T09:09:54.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5874565a-4fc1-442a-af54-f0ba00118986 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95312024-11-14T09:09:54.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5874565a-4fc1-442a-af54-f0ba00118986 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95322024-11-14T09:09:54.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5874565a-4fc1-442a-af54-f0ba00118986 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95332024-11-14T09:09:55.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80a487c7-6b29-4c1c-8a3a-a1ce9475098b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95342024-11-14T09:09:55.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80a487c7-6b29-4c1c-8a3a-a1ce9475098b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95352024-11-14T09:09:55.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80a487c7-6b29-4c1c-8a3a-a1ce9475098b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95362024-11-14T09:09:55.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
95372024-11-14T09:09:55.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
95382024-11-14T09:09:55.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95392024-11-14T09:09:55.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95402024-11-14T09:09:55.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95412024-11-14T09:09:55.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95422024-11-14T09:09:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95432024-11-14T09:09:55.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95442024-11-14T09:09:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95452024-11-14T09:09:55.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95462024-11-14T09:09:55.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95472024-11-14T09:09:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95482024-11-14T09:09:55.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.171913ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95492024-11-14T09:09:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95502024-11-14T09:09:55.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95512024-11-14T09:09:55.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95522024-11-14T09:09:55.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
95532024-11-14T09:09:55.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95542024-11-14T09:09:55.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95552024-11-14T09:09:55.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
95562024-11-14T09:09:55.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.225519ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
95572024-11-14T09:09:56.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6545b70c-472f-4ade-812a-1fc1d26e2813 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95582024-11-14T09:09:56.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6545b70c-472f-4ade-812a-1fc1d26e2813 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95592024-11-14T09:09:56.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6545b70c-472f-4ade-812a-1fc1d26e2813 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95602024-11-14T09:09:57.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c76d6d73-d135-4571-a4c3-70b319802b44 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95612024-11-14T09:09:57.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c76d6d73-d135-4571-a4c3-70b319802b44 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95622024-11-14T09:09:57.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c76d6d73-d135-4571-a4c3-70b319802b44 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95632024-11-14T09:09:58.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1906e3c9-5965-47b5-aac2-ce5f0f3c61af roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95642024-11-14T09:09:58.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1906e3c9-5965-47b5-aac2-ce5f0f3c61af resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95652024-11-14T09:09:58.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1906e3c9-5965-47b5-aac2-ce5f0f3c61af response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95662024-11-14T09:09:59.051ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1518 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = f144ab44-cabe-4c5c-9eaf-07b74ea3f683 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
95672024-11-14T09:09:59.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e6481c0c-3bd9-4b6b-8715-6f570a569260 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95682024-11-14T09:09:59.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e6481c0c-3bd9-4b6b-8715-6f570a569260 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95692024-11-14T09:09:59.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e6481c0c-3bd9-4b6b-8715-6f570a569260 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95702024-11-14T09:10:00.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baf7cf83-4985-468e-a48c-eaada0e5d7f5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95712024-11-14T09:10:00.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baf7cf83-4985-468e-a48c-eaada0e5d7f5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95722024-11-14T09:10:00.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baf7cf83-4985-468e-a48c-eaada0e5d7f5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95732024-11-14T09:10:01.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f4f2a63-e58e-4980-8db2-4aaa118f8665 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95742024-11-14T09:10:01.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f4f2a63-e58e-4980-8db2-4aaa118f8665 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95752024-11-14T09:10:01.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f4f2a63-e58e-4980-8db2-4aaa118f8665 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95762024-11-14T09:10:02.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f3b299d-5552-4bf6-adc0-a10aade03c0d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95772024-11-14T09:10:02.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f3b299d-5552-4bf6-adc0-a10aade03c0d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95782024-11-14T09:10:02.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f3b299d-5552-4bf6-adc0-a10aade03c0d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95792024-11-14T09:10:03.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 373f74db-bed5-43e3-984c-a8f14e9cafbb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95802024-11-14T09:10:03.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 373f74db-bed5-43e3-984c-a8f14e9cafbb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95812024-11-14T09:10:03.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 373f74db-bed5-43e3-984c-a8f14e9cafbb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95822024-11-14T09:10:04.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b941376d-00bb-432f-bb4d-7acbb8cff39e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95832024-11-14T09:10:04.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b941376d-00bb-432f-bb4d-7acbb8cff39e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95842024-11-14T09:10:04.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b941376d-00bb-432f-bb4d-7acbb8cff39e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95852024-11-14T09:10:04.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = eb5b798e-09c4-444f-96dc-b8e8b6638f03 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
95862024-11-14T09:10:04.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = eb5b798e-09c4-444f-96dc-b8e8b6638f03 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
95872024-11-14T09:10:05.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = eb5b798e-09c4-444f-96dc-b8e8b6638f03 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
95882024-11-14T09:10:05.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = b67e8da1-8968-4b3a-9b1f-79ccff40e15f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
95892024-11-14T09:10:05.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = b67e8da1-8968-4b3a-9b1f-79ccff40e15f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
95902024-11-14T09:10:05.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = b67e8da1-8968-4b3a-9b1f-79ccff40e15f response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
95912024-11-14T09:10:05.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9cb96a88-d608-49d7-9bbe-0e83c011693f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95922024-11-14T09:10:05.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9cb96a88-d608-49d7-9bbe-0e83c011693f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95932024-11-14T09:10:05.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9cb96a88-d608-49d7-9bbe-0e83c011693f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
95942024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
95952024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95962024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
95972024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
95982024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95992024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96002024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
96012024-11-14T09:10:05.534ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 09:00:05.534356312 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96022024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96032024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
96042024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
96052024-11-14T09:10:05.534ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
96062024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96072024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.64\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
96082024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96092024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
96102024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
96112024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
96122024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96132024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96142024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96152024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
96162024-11-14T09:10:05.534ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96172024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96182024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
96192024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
96202024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96212024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
96222024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96232024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
96242024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
96252024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96262024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96272024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
96282024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
96292024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96302024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
96312024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96322024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96332024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
96342024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
96352024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96362024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
96372024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96382024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96392024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
96402024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
96412024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
96422024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
96432024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96442024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96452024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
96462024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96472024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96482024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
96492024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
96502024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96512024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96522024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
96532024-11-14T09:10:05.534ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96542024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
96552024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96562024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96572024-11-14T09:10:05.534ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
96582024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96592024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96602024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96612024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96622024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96632024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96642024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96652024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96662024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96672024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96682024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96692024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96702024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96712024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96722024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96732024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96742024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96752024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96762024-11-14T09:10:05.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 319450125 } })
96772024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96782024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96792024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96802024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96812024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96822024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96832024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96842024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96852024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96862024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96872024-11-14T09:10:05.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 319668398 } })
96882024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96892024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96902024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96912024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96922024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96932024-11-14T09:10:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.330931ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96942024-11-14T09:10:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96952024-11-14T09:10:05.536ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
96962024-11-14T09:10:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.480054ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
96972024-11-14T09:10:05.537ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 09:00:05.534356312 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96982024-11-14T09:10:05.537ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.17786ms iteration = 13 status = {"expiration":"2024-11-14T09:00:05.534356312Z","pruned":[]}
96992024-11-14T09:10:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97002024-11-14T09:10:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97012024-11-14T09:10:05.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97022024-11-14T09:10:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97032024-11-14T09:10:05.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.654705ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97042024-11-14T09:10:05.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97052024-11-14T09:10:05.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97062024-11-14T09:10:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97072024-11-14T09:10:05.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97082024-11-14T09:10:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97092024-11-14T09:10:05.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97102024-11-14T09:10:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97112024-11-14T09:10:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97122024-11-14T09:10:05.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 329429785 } })
97132024-11-14T09:10:05.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
97142024-11-14T09:10:05.545ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.831774ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
97152024-11-14T09:10:05.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 331067231 } })
97162024-11-14T09:10:05.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
97172024-11-14T09:10:05.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97182024-11-14T09:10:05.547ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97192024-11-14T09:10:05.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97202024-11-14T09:10:05.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212024-11-14T09:10:05.549ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97222024-11-14T09:10:05.549ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97232024-11-14T09:10:05.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97242024-11-14T09:10:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97252024-11-14T09:10:05.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97262024-11-14T09:10:05.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97272024-11-14T09:10:05.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97282024-11-14T09:10:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97292024-11-14T09:10:05.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97302024-11-14T09:10:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97312024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97322024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97332024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97342024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97352024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97362024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97372024-11-14T09:10:05.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97382024-11-14T09:10:05.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97392024-11-14T09:10:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97402024-11-14T09:10:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97412024-11-14T09:10:05.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 33.717462ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
97422024-11-14T09:10:05.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97432024-11-14T09:10:05.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97442024-11-14T09:10:05.572ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97452024-11-14T09:10:05.572ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97462024-11-14T09:10:05.572ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 37.741856ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97472024-11-14T09:10:05.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482024-11-14T09:10:05.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.955828ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97492024-11-14T09:10:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97502024-11-14T09:10:05.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97512024-11-14T09:10:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97522024-11-14T09:10:05.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97532024-11-14T09:10:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97542024-11-14T09:10:05.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97552024-11-14T09:10:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97562024-11-14T09:10:05.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97572024-11-14T09:10:05.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97582024-11-14T09:10:05.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97592024-11-14T09:10:05.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97602024-11-14T09:10:05.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97612024-11-14T09:10:05.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97622024-11-14T09:10:05.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97632024-11-14T09:10:05.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97642024-11-14T09:10:05.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97652024-11-14T09:10:05.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97662024-11-14T09:10:05.596ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97672024-11-14T09:10:05.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682024-11-14T09:10:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97692024-11-14T09:10:05.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97702024-11-14T09:10:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97712024-11-14T09:10:05.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97722024-11-14T09:10:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97732024-11-14T09:10:05.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97742024-11-14T09:10:05.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97752024-11-14T09:10:05.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97762024-11-14T09:10:05.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97772024-11-14T09:10:05.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97782024-11-14T09:10:05.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97792024-11-14T09:10:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
97802024-11-14T09:10:05.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97812024-11-14T09:10:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97822024-11-14T09:10:05.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97832024-11-14T09:10:05.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97842024-11-14T09:10:05.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97852024-11-14T09:10:05.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97862024-11-14T09:10:05.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.595451ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
97872024-11-14T09:10:05.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882024-11-14T09:10:05.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97892024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97902024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97912024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97922024-11-14T09:10:05.622ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97932024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.110706ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97942024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97952024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97962024-11-14T09:10:05.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97972024-11-14T09:10:05.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97982024-11-14T09:10:05.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97992024-11-14T09:10:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98002024-11-14T09:10:05.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98012024-11-14T09:10:05.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98022024-11-14T09:10:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98032024-11-14T09:10:05.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98042024-11-14T09:10:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98052024-11-14T09:10:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98062024-11-14T09:10:05.627ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98072024-11-14T09:10:05.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98082024-11-14T09:10:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98092024-11-14T09:10:05.628ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98102024-11-14T09:10:05.628ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98112024-11-14T09:10:05.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98122024-11-14T09:10:05.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.684536ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98132024-11-14T09:10:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98142024-11-14T09:10:05.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 413560837 } })
98152024-11-14T09:10:05.629ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
98162024-11-14T09:10:05.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
98172024-11-14T09:10:05.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.700478ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
98182024-11-14T09:10:05.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98192024-11-14T09:10:05.633ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 99.52927ms iteration = 6 status = {"nsuccess":5}
98202024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98212024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98222024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98232024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98242024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98252024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98262024-11-14T09:10:05.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98272024-11-14T09:10:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98282024-11-14T09:10:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98292024-11-14T09:10:05.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.849656ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98302024-11-14T09:10:05.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98312024-11-14T09:10:05.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98322024-11-14T09:10:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98332024-11-14T09:10:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
98342024-11-14T09:10:05.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98352024-11-14T09:10:05.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98362024-11-14T09:10:05.653ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98372024-11-14T09:10:05.671ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98382024-11-14T09:10:05.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98392024-11-14T09:10:05.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98402024-11-14T09:10:05.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98422024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98432024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98442024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98452024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98462024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98472024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98482024-11-14T09:10:05.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98492024-11-14T09:10:05.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98502024-11-14T09:10:05.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98512024-11-14T09:10:05.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.684319ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98522024-11-14T09:10:05.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98532024-11-14T09:10:05.686ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98542024-11-14T09:10:05.686ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98552024-11-14T09:10:05.686ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.273846ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98562024-11-14T09:10:05.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98572024-11-14T09:10:05.688ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98582024-11-14T09:10:05.688ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f18f3b1-38cd-4d76-a88c-b6d8323e289b", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} })
98592024-11-14T09:10:05.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98602024-11-14T09:10:05.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98612024-11-14T09:10:05.706ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98622024-11-14T09:10:05.706ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98632024-11-14T09:10:05.706ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf429b46-0d45-4f7c-b98c-7096e923efb9", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} })
98642024-11-14T09:10:05.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98652024-11-14T09:10:05.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98662024-11-14T09:10:05.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98672024-11-14T09:10:05.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98682024-11-14T09:10:05.729ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98692024-11-14T09:10:05.751ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 217.25576ms iteration = 29 status = {"physical_disks_added":0}
98702024-11-14T09:10:05.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
98712024-11-14T09:10:05.821ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98722024-11-14T09:10:05.821ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dee1d68d-d280-479b-880e-c8dd9e154e48", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} })
98732024-11-14T09:10:05.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98742024-11-14T09:10:05.822ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
98752024-11-14T09:10:05.934ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98762024-11-14T09:10:05.992ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state
98772024-11-14T09:10:05.995ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 460.56423ms iteration = 25 status = 0
98782024-11-14T09:10:05.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98792024-11-14T09:10:05.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98802024-11-14T09:10:05.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98812024-11-14T09:10:05.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98822024-11-14T09:10:05.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98832024-11-14T09:10:06.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98842024-11-14T09:10:06.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98852024-11-14T09:10:06.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98862024-11-14T09:10:06.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98872024-11-14T09:10:06.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98882024-11-14T09:10:06.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98892024-11-14T09:10:06.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98902024-11-14T09:10:06.026ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98912024-11-14T09:10:06.027ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebbc3472-8f38-4d1f-9344-e941c6ca8b84", "content-length": "1", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} })
98922024-11-14T09:10:06.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98932024-11-14T09:10:06.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98942024-11-14T09:10:06.032ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 498.349207ms iteration = 25 status = null
98952024-11-14T09:10:06.033ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98962024-11-14T09:10:06.034ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98972024-11-14T09:10:06.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98982024-11-14T09:10:06.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98992024-11-14T09:10:06.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99002024-11-14T09:10:06.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99012024-11-14T09:10:06.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99022024-11-14T09:10:06.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99032024-11-14T09:10:06.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99042024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99052024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99062024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
99072024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 513.404068ms iteration = 14 status = {"generation":1}
99082024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
99092024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
99102024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99112024-11-14T09:10:06.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99122024-11-14T09:10:06.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99132024-11-14T09:10:06.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99142024-11-14T09:10:06.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99152024-11-14T09:10:06.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99162024-11-14T09:10:06.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99172024-11-14T09:10:06.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99182024-11-14T09:10:06.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99192024-11-14T09:10:06.060ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
99202024-11-14T09:10:06.060ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
99212024-11-14T09:10:06.060ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
99222024-11-14T09:10:06.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 526.073752ms iteration = 14 status = {"generation":2}
99232024-11-14T09:10:06.074ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99242024-11-14T09:10:06.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 540.616725ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99252024-11-14T09:10:06.094ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99262024-11-14T09:10:06.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b8a56d21-a361-41eb-a054-3fc6ffc199bb", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99272024-11-14T09:10:06.094ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99282024-11-14T09:10:06.096ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 561.532951ms iteration = 25 status = {}
99292024-11-14T09:10:06.097ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "68e3e4de-7d5e-4aae-bdaf-f99a64ec7c48", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99302024-11-14T09:10:06.097ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99312024-11-14T09:10:06.099ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
99322024-11-14T09:10:06.099ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 564.686162ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99332024-11-14T09:10:06.099ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99342024-11-14T09:10:06.099ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 564.60132ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99352024-11-14T09:10:06.173ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99362024-11-14T09:10:06.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "637a39c2-4464-4fac-9c2f-7336c0ac9d0d", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99372024-11-14T09:10:06.174ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99382024-11-14T09:10:06.175ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a6a52cc7-33e8-4ac1-b9bf-19717d5a9988", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99392024-11-14T09:10:06.175ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99402024-11-14T09:10:06.178ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "239e9519-43d8-4b00-b296-ef89777468df", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99412024-11-14T09:10:06.178ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99422024-11-14T09:10:06.180ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
99432024-11-14T09:10:06.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 646.274743ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99442024-11-14T09:10:06.200ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99452024-11-14T09:10:06.201ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61eb3ead-a3bb-41ab-8cec-08b4236cad9d", "content-length": "810", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99462024-11-14T09:10:06.201ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(7742553) }} sled = buskin
99472024-11-14T09:10:06.201ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99482024-11-14T09:10:06.201ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99492024-11-14T09:10:06.203ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 669.066529ms iteration = 25 status = {}
99502024-11-14T09:10:06.218ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99512024-11-14T09:10:06.218ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99522024-11-14T09:10:06.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "be1042f2-7089-41bc-ae18-8009c2464589", "content-length": "583", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99532024-11-14T09:10:06.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99542024-11-14T09:10:06.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99552024-11-14T09:10:06.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99562024-11-14T09:10:06.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99572024-11-14T09:10:06.230ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
99582024-11-14T09:10:06.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99592024-11-14T09:10:06.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99602024-11-14T09:10:06.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99612024-11-14T09:10:06.244ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d3ac2c9-3f28-4147-b385-8fbfe4fc7a50", "content-length": "134", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99622024-11-14T09:10:06.244ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99632024-11-14T09:10:06.244ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
99642024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99652024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99662024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99672024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99682024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99692024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99702024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99712024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99722024-11-14T09:10:06.245ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
99732024-11-14T09:10:06.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99742024-11-14T09:10:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99752024-11-14T09:10:06.249ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99762024-11-14T09:10:06.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3271985f-864f-4e1b-92a0-0950de4613a3", "content-length": "2", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99772024-11-14T09:10:06.249ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99782024-11-14T09:10:06.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "47665957-4b44-4f0a-aba1-bfb6ae6ba5f5", "content-length": "52", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99792024-11-14T09:10:06.249ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
99802024-11-14T09:10:06.249ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99812024-11-14T09:10:06.279ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {afd7a81f-2b99-4dc7-a4a4-51f62010e2b7: {10.151.1.175: {a02413d9-e2c1-4708-8e13-eda1e94e4206}, 10.151.1.176: {a02413d9-e2c1-4708-8e13-eda1e94e4206}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99822024-11-14T09:10:06.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99832024-11-14T09:10:06.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a61daa48-c504-46ab-a17b-59548a2ba912", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99842024-11-14T09:10:06.414ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
99852024-11-14T09:10:06.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99862024-11-14T09:10:06.415ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "280d9621-4420-4b90-bb6b-a72a67578dff", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
99872024-11-14T09:10:06.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99882024-11-14T09:10:06.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99892024-11-14T09:10:06.415ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e57f3a9-f588-4a6a-bdb9-0adbcd995889", "content-length": "682", "date": "Thu, 14 Nov 2024 09:10:05 GMT"} })
99902024-11-14T09:10:06.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99912024-11-14T09:10:06.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99922024-11-14T09:10:06.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99932024-11-14T09:10:06.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99942024-11-14T09:10:06.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99952024-11-14T09:10:06.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99962024-11-14T09:10:06.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99972024-11-14T09:10:06.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99982024-11-14T09:10:06.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99992024-11-14T09:10:06.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100002024-11-14T09:10:06.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100012024-11-14T09:10:06.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100022024-11-14T09:10:06.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100032024-11-14T09:10:06.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100042024-11-14T09:10:06.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100052024-11-14T09:10:06.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100062024-11-14T09:10:06.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100072024-11-14T09:10:06.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100082024-11-14T09:10:06.438ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 903.940633ms iteration = 25 status = {}
100092024-11-14T09:10:06.440ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100102024-11-14T09:10:06.440ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100112024-11-14T09:10:06.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100122024-11-14T09:10:06.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9f67e8e3-bf15-4b43-844e-4c6cc9901d35", "date": "Thu, 14 Nov 2024 09:10:06 GMT"} })
100132024-11-14T09:10:06.443ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 908.593837ms iteration = 26 status = {}
100142024-11-14T09:10:06.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cee3075d-a09f-4561-bff1-8f80e98ff32d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100152024-11-14T09:10:06.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cee3075d-a09f-4561-bff1-8f80e98ff32d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100162024-11-14T09:10:06.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cee3075d-a09f-4561-bff1-8f80e98ff32d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100172024-11-14T09:10:07.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6e915204-078f-448a-89eb-5830da2c4994 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100182024-11-14T09:10:07.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6e915204-078f-448a-89eb-5830da2c4994 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100192024-11-14T09:10:07.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6e915204-078f-448a-89eb-5830da2c4994 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100202024-11-14T09:10:08.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e3a423e-1cbb-42ab-9d0f-51f1a2a8dc49 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100212024-11-14T09:10:08.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e3a423e-1cbb-42ab-9d0f-51f1a2a8dc49 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100222024-11-14T09:10:08.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e3a423e-1cbb-42ab-9d0f-51f1a2a8dc49 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100232024-11-14T09:10:09.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9398b1fd-e4e0-41da-9f7d-baf49dbcee52 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100242024-11-14T09:10:09.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9398b1fd-e4e0-41da-9f7d-baf49dbcee52 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100252024-11-14T09:10:09.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9398b1fd-e4e0-41da-9f7d-baf49dbcee52 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100262024-11-14T09:10:10.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 001b1917-de3d-47a9-9758-c3f795241252 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100272024-11-14T09:10:10.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 001b1917-de3d-47a9-9758-c3f795241252 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100282024-11-14T09:10:10.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 001b1917-de3d-47a9-9758-c3f795241252 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100292024-11-14T09:10:11.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4b3e31a7-0e5e-49b1-bd79-6e0a6ce2c5cd roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100302024-11-14T09:10:11.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4b3e31a7-0e5e-49b1-bd79-6e0a6ce2c5cd resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100312024-11-14T09:10:11.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4b3e31a7-0e5e-49b1-bd79-6e0a6ce2c5cd response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100322024-11-14T09:10:12.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4dbefa0-b411-4bb2-9873-0f83ad9aef04 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100332024-11-14T09:10:12.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4dbefa0-b411-4bb2-9873-0f83ad9aef04 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100342024-11-14T09:10:12.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4dbefa0-b411-4bb2-9873-0f83ad9aef04 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100352024-11-14T09:10:13.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e4a46259-6267-4e91-a8d6-a3020e69d248 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100362024-11-14T09:10:13.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e4a46259-6267-4e91-a8d6-a3020e69d248 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100372024-11-14T09:10:13.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e4a46259-6267-4e91-a8d6-a3020e69d248 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100382024-11-14T09:10:14.051ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1261 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 8b7dafe2-4874-4838-b16e-4cea5a77f9a0 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
100392024-11-14T09:10:14.375ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c740a4f-d368-40d5-927d-4b05070f9eae", "content-length": "131", "date": "Thu, 14 Nov 2024 09:10:14 GMT"} })
100402024-11-14T09:10:14.377ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee823011-cdec-458c-8448-64c486f0530e uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T09:10:14.376565869Z }
100412024-11-14T09:10:14.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee823011-cdec-458c-8448-64c486f0530e roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
100422024-11-14T09:10:14.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee823011-cdec-458c-8448-64c486f0530e resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
100432024-11-14T09:10:14.378ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T09:10:05.263056383Z }, migration_in: None, migration_out: None } vmm_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
100442024-11-14T09:10:14.378ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 vmm_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T09:10:05.263056383Z }
100452024-11-14T09:10:14.378ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 roles = RoleSet { roles: {} } sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 vmm_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
100462024-11-14T09:10:14.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 resource = Database result = Ok(()) sled_id = 65d2236a-3110-4d84-aa25-77e21779db87 vmm_id = d785d5c4-4fef-4c27-9392-a8d40aec1576
100472024-11-14T09:10:14.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19565 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ee823011-cdec-458c-8448-64c486f0530e response_code = 204 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
100482024-11-14T09:10:14.400ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1ede373-d989-45d8-b17e-6c7aa7eabd8a uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T09:10:14.400557184Z }
100492024-11-14T09:10:14.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1ede373-d989-45d8-b17e-6c7aa7eabd8a roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
100502024-11-14T09:10:14.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1ede373-d989-45d8-b17e-6c7aa7eabd8a resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
100512024-11-14T09:10:14.408ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:65360
100522024-11-14T09:10:14.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:65360 req_id = b2c58edd-054d-41b7-af18-e47e4c5bb8c6 roles = RoleSet { roles: {} } uri = /metrics/producers
100532024-11-14T09:10:14.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:65360 req_id = b2c58edd-054d-41b7-af18-e47e4c5bb8c6 resource = Database result = Ok(()) uri = /metrics/producers
100542024-11-14T09:10:14.413ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
100552024-11-14T09:10:14.415ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 8.88089147s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
100562024-11-14T09:10:14.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36935 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1ede373-d989-45d8-b17e-6c7aa7eabd8a response_code = 204 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
100572024-11-14T09:10:14.445ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = d7226786-0fed-42c5-98e3-b855e6f1b674
100582024-11-14T09:10:14.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37706 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:65360 req_id = b2c58edd-054d-41b7-af18-e47e4c5bb8c6 response_code = 201 uri = /metrics/producers
100592024-11-14T09:10:14.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e344d5af-c37d-4c2b-b6c3-d3566d9fad16 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100602024-11-14T09:10:14.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e344d5af-c37d-4c2b-b6c3-d3566d9fad16 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100612024-11-14T09:10:14.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e344d5af-c37d-4c2b-b6c3-d3566d9fad16 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100622024-11-14T09:10:15.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
100632024-11-14T09:10:15.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100642024-11-14T09:10:15.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
100652024-11-14T09:10:15.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100662024-11-14T09:10:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100672024-11-14T09:10:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100682024-11-14T09:10:15.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100692024-11-14T09:10:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100702024-11-14T09:10:15.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100712024-11-14T09:10:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100722024-11-14T09:10:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100732024-11-14T09:10:15.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100742024-11-14T09:10:15.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100752024-11-14T09:10:15.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
100762024-11-14T09:10:15.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100772024-11-14T09:10:15.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100782024-11-14T09:10:15.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
100792024-11-14T09:10:15.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.459629ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
100802024-11-14T09:10:15.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100812024-11-14T09:10:15.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100822024-11-14T09:10:15.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.016339ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100832024-11-14T09:10:15.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6738fdbf-c7f5-4bd4-85f7-399129630976 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100842024-11-14T09:10:15.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6738fdbf-c7f5-4bd4-85f7-399129630976 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100852024-11-14T09:10:15.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6738fdbf-c7f5-4bd4-85f7-399129630976 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100862024-11-14T09:10:16.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d8c1cda7-a335-4982-a2d5-0e2aa4329d43 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100872024-11-14T09:10:16.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d8c1cda7-a335-4982-a2d5-0e2aa4329d43 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100882024-11-14T09:10:16.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d8c1cda7-a335-4982-a2d5-0e2aa4329d43 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100892024-11-14T09:10:17.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 750fbf64-4364-45b3-b939-b3531c72bfd6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100902024-11-14T09:10:17.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 750fbf64-4364-45b3-b939-b3531c72bfd6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100912024-11-14T09:10:17.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 750fbf64-4364-45b3-b939-b3531c72bfd6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100922024-11-14T09:10:18.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f38ddb7-4f27-46d5-80c1-66ca083328d0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100932024-11-14T09:10:18.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f38ddb7-4f27-46d5-80c1-66ca083328d0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100942024-11-14T09:10:18.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f38ddb7-4f27-46d5-80c1-66ca083328d0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100952024-11-14T09:10:19.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 560c71f7-0515-4bbf-979e-4c88c17dca5b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100962024-11-14T09:10:19.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 560c71f7-0515-4bbf-979e-4c88c17dca5b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100972024-11-14T09:10:19.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 560c71f7-0515-4bbf-979e-4c88c17dca5b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100982024-11-14T09:10:20.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f1747b3e-42f9-4dfd-8eea-d9037fb37624 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
100992024-11-14T09:10:20.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f1747b3e-42f9-4dfd-8eea-d9037fb37624 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101002024-11-14T09:10:20.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f1747b3e-42f9-4dfd-8eea-d9037fb37624 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101012024-11-14T09:10:21.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8fd5c739-cb97-4b75-9ba4-dc95d6f6bdd6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101022024-11-14T09:10:21.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8fd5c739-cb97-4b75-9ba4-dc95d6f6bdd6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101032024-11-14T09:10:21.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8fd5c739-cb97-4b75-9ba4-dc95d6f6bdd6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101042024-11-14T09:10:22.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b3208d5-c9f8-481c-9fd0-eeda86a7d592 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101052024-11-14T09:10:22.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b3208d5-c9f8-481c-9fd0-eeda86a7d592 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101062024-11-14T09:10:22.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3b3208d5-c9f8-481c-9fd0-eeda86a7d592 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101072024-11-14T09:10:23.103ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae6354f-154c-4445-9501-b7408ee1096b uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T09:10:23.103219929Z }
101082024-11-14T09:10:23.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae6354f-154c-4445-9501-b7408ee1096b roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101092024-11-14T09:10:23.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae6354f-154c-4445-9501-b7408ee1096b resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101102024-11-14T09:10:23.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40111 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dae6354f-154c-4445-9501-b7408ee1096b response_code = 204 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101112024-11-14T09:10:23.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cedf0fee-8c22-45bb-a59c-ae8858fcaf36 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101122024-11-14T09:10:23.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cedf0fee-8c22-45bb-a59c-ae8858fcaf36 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101132024-11-14T09:10:23.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cedf0fee-8c22-45bb-a59c-ae8858fcaf36 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101142024-11-14T09:10:24.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 38e6a705-5767-4305-b6ff-76cf6dde09fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
101152024-11-14T09:10:24.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 38e6a705-5767-4305-b6ff-76cf6dde09fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
101162024-11-14T09:10:24.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 38e6a705-5767-4305-b6ff-76cf6dde09fe response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
101172024-11-14T09:10:24.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = fdd16214-7100-4227-928f-0301bbd6b68c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
101182024-11-14T09:10:24.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = fdd16214-7100-4227-928f-0301bbd6b68c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
101192024-11-14T09:10:24.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = fdd16214-7100-4227-928f-0301bbd6b68c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
101202024-11-14T09:10:24.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d73f0110-0bca-4c15-ac3e-865138dc1bad roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101212024-11-14T09:10:24.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d73f0110-0bca-4c15-ac3e-865138dc1bad resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101222024-11-14T09:10:24.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d73f0110-0bca-4c15-ac3e-865138dc1bad response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
101232024-11-14T09:10:25.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3137d02d-e1f4-43f4-8b38-6f4ad9def51d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
101242024-11-14T09:10:25.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3137d02d-e1f4-43f4-8b38-6f4ad9def51d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
101252024-11-14T09:10:25.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 3137d02d-e1f4-43f4-8b38-6f4ad9def51d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
101262024-11-14T09:10:25.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
101272024-11-14T09:10:25.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
101282024-11-14T09:10:25.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101292024-11-14T09:10:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101302024-11-14T09:10:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101312024-11-14T09:10:25.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101322024-11-14T09:10:25.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101332024-11-14T09:10:25.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101342024-11-14T09:10:25.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101352024-11-14T09:10:25.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101362024-11-14T09:10:25.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101372024-11-14T09:10:25.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101382024-11-14T09:10:25.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101392024-11-14T09:10:25.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101402024-11-14T09:10:25.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101412024-11-14T09:10:25.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
101422024-11-14T09:10:25.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101432024-11-14T09:10:25.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101442024-11-14T09:10:25.576ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T09:10:25.575776933Z }
101452024-11-14T09:10:25.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101462024-11-14T09:10:25.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101472024-11-14T09:10:25.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
101482024-11-14T09:10:25.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.168914ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
101492024-11-14T09:10:25.584ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_needs_update = true
101502024-11-14T09:10:25.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101512024-11-14T09:10:25.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101522024-11-14T09:10:25.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101532024-11-14T09:10:25.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101542024-11-14T09:10:25.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101552024-11-14T09:10:25.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101562024-11-14T09:10:25.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101572024-11-14T09:10:25.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101582024-11-14T09:10:25.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.629064ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101592024-11-14T09:10:25.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101602024-11-14T09:10:25.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101612024-11-14T09:10:25.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101622024-11-14T09:10:25.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101632024-11-14T09:10:25.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101642024-11-14T09:10:25.600ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, lookup_type: ById(4528c2fc-966b-410e-bee5-f98d6efd8ad1) }, key: 8004ae3c-25df-43c0-8904-6502f5426c94, lookup_type: ById(8004ae3c-25df-43c0-8904-6502f5426c94) }, key: d7226786-0fed-42c5-98e3-b855e6f1b674, lookup_type: ById(d7226786-0fed-42c5-98e3-b855e6f1b674) } result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101652024-11-14T09:10:25.600ZINFOnexus (dropshot_internal): starting update saga for d7226786-0fed-42c5-98e3-b855e6f1b674 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T09:10:25.575776933Z }
101662024-11-14T09:10:25.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24693 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 response_code = 204 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101672024-11-14T09:10:25.600ZDEBGnexus (dropshot_internal): preparing instance-update saga for d7226786-0fed-42c5-98e3-b855e6f1b674... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b4b9aa9-1f44-4686-9098-27827061ecf4 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101682024-11-14T09:10:25.600ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update
101692024-11-14T09:10:25.600ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d7226786-0fed-42c5-98e3-b855e6f1b674","lookup_type":{"ById":"d7226786-0fed-42c5-98e3-b855e6f1b674"},"parent":{"key":"8004ae3c-25df-43c0-8904-6502f5426c94","lookup_type":{"ById":"8004ae3c-25df-43c0-8904-6502f5426c94"},"parent":{"key":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","lookup_type":{"ById":"4528c2fc-966b-410e-bee5-f98d6efd8ad1"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101702024-11-14T09:10:25.600ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update
101712024-11-14T09:10:25.601ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12e14827-90e5-46b1-a165-c3459152edd5 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T09:10:25.575776933Z }
101722024-11-14T09:10:25.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12e14827-90e5-46b1-a165-c3459152edd5 roles = RoleSet { roles: {} } uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101732024-11-14T09:10:25.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12e14827-90e5-46b1-a165-c3459152edd5 resource = Database result = Ok(()) uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101742024-11-14T09:10:25.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4183 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12e14827-90e5-46b1-a165-c3459152edd5 response_code = 204 uri = /vmms/d785d5c4-4fef-4c27-9392-a8d40aec1576
101752024-11-14T09:10:25.630ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update
101762024-11-14T09:10:25.630ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101772024-11-14T09:10:25.630ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101782024-11-14T09:10:25.630ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
101792024-11-14T09:10:25.635ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101802024-11-14T09:10:25.635ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
101812024-11-14T09:10:25.638ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101822024-11-14T09:10:25.638ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
101832024-11-14T09:10:25.642ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101842024-11-14T09:10:25.642ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5232e37e-54d3-43a8-9ff6-f4add42f9e83")) node_id = 0 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
101852024-11-14T09:10:25.645ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
101862024-11-14T09:10:25.645ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
101872024-11-14T09:10:25.649ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update
101882024-11-14T09:10:25.649ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101892024-11-14T09:10:25.649ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101902024-11-14T09:10:25.651ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101912024-11-14T09:10:25.651ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101922024-11-14T09:10:25.653ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101932024-11-14T09:10:25.653ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101942024-11-14T09:10:25.657ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101952024-11-14T09:10:25.658ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101962024-11-14T09:10:25.659ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101972024-11-14T09:10:25.659ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101982024-11-14T09:10:25.661ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
101992024-11-14T09:10:25.661ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102002024-11-14T09:10:25.662ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102012024-11-14T09:10:25.665ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, lookup_type: ById(4528c2fc-966b-410e-bee5-f98d6efd8ad1) }, key: 8004ae3c-25df-43c0-8904-6502f5426c94, lookup_type: ById(8004ae3c-25df-43c0-8904-6502f5426c94) }, key: d7226786-0fed-42c5-98e3-b855e6f1b674, lookup_type: ById(d7226786-0fed-42c5-98e3-b855e6f1b674) } result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102022024-11-14T09:10:25.665ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance updater_id = 5232e37e-54d3-43a8-9ff6-f4add42f9e83
102032024-11-14T09:10:25.665ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102042024-11-14T09:10:25.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102052024-11-14T09:10:25.674ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance updater_id = 5232e37e-54d3-43a8-9ff6-f4add42f9e83
102062024-11-14T09:10:25.674ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102072024-11-14T09:10:25.674ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance
102082024-11-14T09:10:25.678ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 locked_gen = Generation(Generation(2)) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = LockInstance updater_id = 5232e37e-54d3-43a8-9ff6-f4add42f9e83
102092024-11-14T09:10:25.681ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102102024-11-14T09:10:25.681ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5232e37e-54d3-43a8-9ff6-f4add42f9e83")}) node_id = 1 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
102112024-11-14T09:10:25.685ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102122024-11-14T09:10:25.685ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
102132024-11-14T09:10:25.688ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102142024-11-14T09:10:25.689ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102152024-11-14T09:10:25.689ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102162024-11-14T09:10:25.690ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102172024-11-14T09:10:25.691ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102182024-11-14T09:10:25.691ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102192024-11-14T09:10:25.692ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102202024-11-14T09:10:25.695ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, lookup_type: ById(4528c2fc-966b-410e-bee5-f98d6efd8ad1) }, key: 8004ae3c-25df-43c0-8904-6502f5426c94, lookup_type: ById(8004ae3c-25df-43c0-8904-6502f5426c94) }, key: d7226786-0fed-42c5-98e3-b855e6f1b674, lookup_type: ById(d7226786-0fed-42c5-98e3-b855e6f1b674) } result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102212024-11-14T09:10:25.695ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102222024-11-14T09:10:25.696ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
102232024-11-14T09:10:25.701ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: d785d5c4-4fef-4c27-9392-a8d40aec1576, time_created: 2024-11-14T09:10:04.728715Z, time_deleted: None, instance_id: d7226786-0fed-42c5-98e3-b855e6f1b674, sled_id: 65d2236a-3110-4d84-aa25-77e21779db87, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-14T09:10:25.575776Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T09:10:02.339303Z, gen: Generation(Generation(3)), propolis_id: Some(d785d5c4-4fef-4c27-9392-a8d40aec1576), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(d785d5c4-4fef-4c27-9392-a8d40aec1576 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T09:10:25.701653536Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
102242024-11-14T09:10:25.704ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102252024-11-14T09:10:25.706ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d7226786-0fed-42c5-98e3-b855e6f1b674","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"d785d5c4-4fef-4c27-9392-a8d40aec1576"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"d7226786-0fed-42c5-98e3-b855e6f1b674","lookup_type":{"ById":"d7226786-0fed-42c5-98e3-b855e6f1b674"},"parent":{"key":"8004ae3c-25df-43c0-8904-6502f5426c94","lookup_type":{"ById":"8004ae3c-25df-43c0-8904-6502f5426c94"},"parent":{"key":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","lookup_type":{"ById":"4528c2fc-966b-410e-bee5-f98d6efd8ad1"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"5232e37e-54d3-43a8-9ff6-f4add42f9e83"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"8004ae3c-25df-43c0-8904-6502f5426c94","ram_diff":1073741824},"destroy_active_vmm":"d785d5c4-4fef-4c27-9392-a8d40aec1576","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-14T09:10:25.701653536Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102262024-11-14T09:10:25.706ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102272024-11-14T09:10:25.737ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102282024-11-14T09:10:25.737ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102292024-11-14T09:10:25.737ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102302024-11-14T09:10:25.737ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102312024-11-14T09:10:25.741ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102322024-11-14T09:10:25.741ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102332024-11-14T09:10:25.744ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102342024-11-14T09:10:25.744ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102352024-11-14T09:10:25.747ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102362024-11-14T09:10:25.747ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084")) node_id = 0 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102372024-11-14T09:10:25.751ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102382024-11-14T09:10:25.751ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102392024-11-14T09:10:25.757ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 parent_lock = UpdaterLock { updater_id: 5232e37e-54d3-43a8-9ff6-f4add42f9e83, locked_gen: Generation(Generation(2)) } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102402024-11-14T09:10:25.757ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = BecomeUpdater
102412024-11-14T09:10:25.757ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = BecomeUpdater
102422024-11-14T09:10:25.767ZDEBGnexus (SagaExecutor): inherited lock from 5232e37e-54d3-43a8-9ff6-f4add42f9e83 to ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 5232e37e-54d3-43a8-9ff6-f4add42f9e83 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = BecomeUpdater updater_id = ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084
102432024-11-14T09:10:25.767ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102442024-11-14T09:10:25.767ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102452024-11-14T09:10:25.767ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084")}) node_id = 1 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102462024-11-14T09:10:25.770ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102472024-11-14T09:10:25.770ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102482024-11-14T09:10:25.773ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102492024-11-14T09:10:25.773ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102502024-11-14T09:10:25.777ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102512024-11-14T09:10:25.777ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102522024-11-14T09:10:25.781ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102532024-11-14T09:10:25.783ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674
102542024-11-14T09:10:25.786ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UpdateNetworkConfig
102552024-11-14T09:10:25.786ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UpdateNetworkConfig
102562024-11-14T09:10:25.789ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UpdateNetworkConfig
102572024-11-14T09:10:25.789ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UpdateNetworkConfig
102582024-11-14T09:10:25.791ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
102592024-11-14T09:10:25.791ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UpdateNetworkConfig
102602024-11-14T09:10:25.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UpdateNetworkConfig
102612024-11-14T09:10:25.793ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
102622024-11-14T09:10:25.794ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
102632024-11-14T09:10:25.794ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
102642024-11-14T09:10:25.795ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
102652024-11-14T09:10:25.796ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
102662024-11-14T09:10:25.796ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
102672024-11-14T09:10:25.796ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
102682024-11-14T09:10:25.801ZDEBGnexus: notifying dendrite of updates instance_id = Some(d7226786-0fed-42c5-98e3-b855e6f1b674 (instance)) switch = switch0
102692024-11-14T09:10:25.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 586091029 } })
102702024-11-14T09:10:25.802ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
102712024-11-14T09:10:25.832ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
102722024-11-14T09:10:25.832ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102732024-11-14T09:10:25.832ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad11c0f3-3c7e-4a75-a48f-4388dab814ca", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:25 GMT"} })
102742024-11-14T09:10:25.832ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102752024-11-14T09:10:25.833ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102762024-11-14T09:10:25.862ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
102772024-11-14T09:10:25.862ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "89d46dd5-e109-439a-910c-f6f7f3f017dd", "content-length": "4", "date": "Thu, 14 Nov 2024 09:10:25 GMT"} })
102782024-11-14T09:10:25.863ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102792024-11-14T09:10:25.863ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102802024-11-14T09:10:25.867ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102812024-11-14T09:10:25.867ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102822024-11-14T09:10:25.870ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
102832024-11-14T09:10:25.871ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
102842024-11-14T09:10:25.880ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-14T09:10:25.873724Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, time_modified: Some(2024-11-14T09:10:25.873724Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8004ae3c-25df-43c0-8904-6502f5426c94, time_modified: Some(2024-11-14T09:10:25.873724Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102852024-11-14T09:10:25.880ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102862024-11-14T09:10:25.880ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102872024-11-14T09:10:25.887ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
102882024-11-14T09:10:25.887ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
102892024-11-14T09:10:25.892ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102902024-11-14T09:10:25.894ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UnassignOximeterProducer
102912024-11-14T09:10:25.895ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UnassignOximeterProducer
102922024-11-14T09:10:25.902ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 487ff140-60d3-41ba-8767-caa53806d612 producer_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102932024-11-14T09:10:25.902ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UnassignOximeterProducer
102942024-11-14T09:10:25.902ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = UnassignOximeterProducer
102952024-11-14T09:10:25.937ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102962024-11-14T09:10:25.940ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/d7226786-0fed-42c5-98e3-b855e6f1b674
102972024-11-14T09:10:25.955ZDEBGnexus (SagaExecutor): client response oximeter-collector = d7226786-0fed-42c5-98e3-b855e6f1b674 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/d7226786-0fed-42c5-98e3-b855e6f1b674", status: 204, headers: {"x-request-id": "e0bc35a4-fb0c-484f-a3c6-7ad1657ca342", "date": "Thu, 14 Nov 2024 09:10:25 GMT"} }) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102982024-11-14T09:10:25.955ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 487ff140-60d3-41ba-8767-caa53806d612 producer_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
102992024-11-14T09:10:25.957ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103002024-11-14T09:10:25.957ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103012024-11-14T09:10:25.961ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103022024-11-14T09:10:25.961ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103032024-11-14T09:10:25.965ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 lock = UpdaterLock { updater_id: ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T09:10:25.701653536Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
103042024-11-14T09:10:25.965ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = CommitInstanceUpdates
103052024-11-14T09:10:25.965ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = CommitInstanceUpdates
103062024-11-14T09:10:25.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba8f8311-0eca-406e-a175-7e3cb38d9c52 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
103072024-11-14T09:10:25.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba8f8311-0eca-406e-a175-7e3cb38d9c52 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
103082024-11-14T09:10:25.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ba8f8311-0eca-406e-a175-7e3cb38d9c52 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
103092024-11-14T09:10:26.012ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T09:10:25.701653536Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
103102024-11-14T09:10:26.012ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103112024-11-14T09:10:26.012ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103122024-11-14T09:10:26.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
103132024-11-14T09:10:26.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103142024-11-14T09:10:26.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
103152024-11-14T09:10:26.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103162024-11-14T09:10:26.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103172024-11-14T09:10:26.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103182024-11-14T09:10:26.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103192024-11-14T09:10:26.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103202024-11-14T09:10:26.016ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103212024-11-14T09:10:26.016ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103222024-11-14T09:10:26.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103232024-11-14T09:10:26.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103242024-11-14T09:10:26.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103252024-11-14T09:10:26.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103262024-11-14T09:10:26.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103272024-11-14T09:10:26.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103282024-11-14T09:10:26.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103292024-11-14T09:10:26.021ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103302024-11-14T09:10:26.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d7226786-0fed-42c5-98e3-b855e6f1b674"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d785d5c4-4fef-4c27-9392-a8d40aec1576")}) node_id = 7 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103312024-11-14T09:10:26.025ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103322024-11-14T09:10:26.025ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103332024-11-14T09:10:26.028ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103342024-11-14T09:10:26.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103352024-11-14T09:10:26.032ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103362024-11-14T09:10:26.032ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103372024-11-14T09:10:26.035ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
103382024-11-14T09:10:26.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ReleaseSledResources
103392024-11-14T09:10:26.036ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ReleaseSledResources
103402024-11-14T09:10:26.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 378c4fa7-002e-40ef-b757-428317ab4475 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
103412024-11-14T09:10:26.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 378c4fa7-002e-40ef-b757-428317ab4475 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
103422024-11-14T09:10:26.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 378c4fa7-002e-40ef-b757-428317ab4475 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
103432024-11-14T09:10:26.041ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103442024-11-14T09:10:26.041ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103452024-11-14T09:10:26.044ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103462024-11-14T09:10:26.044ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103472024-11-14T09:10:26.047ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 propolis_id = d785d5c4-4fef-4c27-9392-a8d40aec1576 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
103482024-11-14T09:10:26.047ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = MarkVmmDeleted
103492024-11-14T09:10:26.047ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = MarkVmmDeleted
103502024-11-14T09:10:26.058ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103512024-11-14T09:10:26.058ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103522024-11-14T09:10:26.061ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103532024-11-14T09:10:26.061ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103542024-11-14T09:10:26.065ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103552024-11-14T09:10:26.065ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103562024-11-14T09:10:26.068ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103572024-11-14T09:10:26.068ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103582024-11-14T09:10:26.077ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103592024-11-14T09:10:26.077ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103602024-11-14T09:10:26.078ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103612024-11-14T09:10:26.079ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103622024-11-14T09:10:26.080ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103632024-11-14T09:10:26.081ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103642024-11-14T09:10:26.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103652024-11-14T09:10:26.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103662024-11-14T09:10:26.082ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103672024-11-14T09:10:26.085ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, lookup_type: ById(4528c2fc-966b-410e-bee5-f98d6efd8ad1) }, key: 8004ae3c-25df-43c0-8904-6502f5426c94, lookup_type: ById(8004ae3c-25df-43c0-8904-6502f5426c94) }, key: d7226786-0fed-42c5-98e3-b855e6f1b674, lookup_type: ById(d7226786-0fed-42c5-98e3-b855e6f1b674) } result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103682024-11-14T09:10:26.085ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103692024-11-14T09:10:26.085ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_node = ChainSuccessorSaga
103702024-11-14T09:10:26.090ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update
103712024-11-14T09:10:26.090ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103722024-11-14T09:10:26.090ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103732024-11-14T09:10:26.095ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103742024-11-14T09:10:26.095ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103752024-11-14T09:10:26.113ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103762024-11-14T09:10:26.113ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103772024-11-14T09:10:26.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc6d5a2c-b366-4892-8d75-f19954c6f808", "content-length": "372", "date": "Thu, 14 Nov 2024 09:10:26 GMT"} })
103782024-11-14T09:10:26.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103792024-11-14T09:10:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103802024-11-14T09:10:26.117ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103812024-11-14T09:10:26.117ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103822024-11-14T09:10:26.121ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103832024-11-14T09:10:26.121ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514
103842024-11-14T09:10:26.127ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103852024-11-14T09:10:26.127ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103862024-11-14T09:10:26.127ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7cff28ea-c1b5-40e3-9066-27e3e24f9fcf", "date": "Thu, 14 Nov 2024 09:10:26 GMT"} })
103872024-11-14T09:10:26.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103882024-11-14T09:10:26.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103892024-11-14T09:10:26.129ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103902024-11-14T09:10:26.129ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 saga_name = instance-update saga_result = SagaResult { saga_id: 9cfb96bf-ff39-40ad-9e4a-69f214cc7514, saga_log: SagaLog { saga_id: 9cfb96bf-ff39-40ad-9e4a-69f214cc7514, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d7226786-0fed-42c5-98e3-b855e6f1b674"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d785d5c4-4fef-4c27-9392-a8d40aec1576")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d7226786-0fed-42c5-98e3-b855e6f1b674"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d785d5c4-4fef-4c27-9392-a8d40aec1576")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ad7bea3b-ee7d-4ea0-94bd-e24a8bf56084")}} }) }
103912024-11-14T09:10:26.129ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 9cfb96bf-ff39-40ad-9e4a-69f214cc7514 instance_id = d7226786-0fed-42c5-98e3-b855e6f1b674 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update
103922024-11-14T09:10:26.129ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103932024-11-14T09:10:26.129ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
103942024-11-14T09:10:26.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103952024-11-14T09:10:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103962024-11-14T09:10:26.132ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
103972024-11-14T09:10:26.132ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
103982024-11-14T09:10:26.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103992024-11-14T09:10:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104002024-11-14T09:10:26.136ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
104012024-11-14T09:10:26.136ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104022024-11-14T09:10:26.136ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
104032024-11-14T09:10:26.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104042024-11-14T09:10:26.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b3f5ef2-9287-43e6-93e0-05b44c9ac3ad", "date": "Thu, 14 Nov 2024 09:10:26 GMT"} })
104052024-11-14T09:10:26.137ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 125.253832ms iteration = 27 status = {}
104062024-11-14T09:10:26.140ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
104072024-11-14T09:10:26.140ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0
104082024-11-14T09:10:26.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104092024-11-14T09:10:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104102024-11-14T09:10:26.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104112024-11-14T09:10:26.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104122024-11-14T09:10:26.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104132024-11-14T09:10:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104142024-11-14T09:10:26.174ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update sec_id = 484a1c50-302f-49ec-9214-2179c2ff7104
104152024-11-14T09:10:26.174ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3d67abc9-0b17-4b6e-8876-4804a9b6acb0 saga_name = start-instance-update saga_result = SagaResult { saga_id: 3d67abc9-0b17-4b6e-8876-4804a9b6acb0, saga_log: SagaLog { saga_id: 3d67abc9-0b17-4b6e-8876-4804a9b6acb0, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("5232e37e-54d3-43a8-9ff6-f4add42f9e83")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5232e37e-54d3-43a8-9ff6-f4add42f9e83")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("5232e37e-54d3-43a8-9ff6-f4add42f9e83"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("5232e37e-54d3-43a8-9ff6-f4add42f9e83")}} }) }
104162024-11-14T09:10:26.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104172024-11-14T09:10:26.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104182024-11-14T09:10:26.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104192024-11-14T09:10:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104202024-11-14T09:10:26.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104212024-11-14T09:10:26.262ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "76affdbf-56d1-4d89-ab32-b2bdd62f7bde", "content-length": "691", "date": "Thu, 14 Nov 2024 09:10:26 GMT"} })
104222024-11-14T09:10:26.262ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
104232024-11-14T09:10:26.262ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
104242024-11-14T09:10:26.262ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
104252024-11-14T09:10:26.264ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 251.957107ms iteration = 26 status = {}
104262024-11-14T09:10:27.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 35c19774-c19d-40bb-974d-3402d51f2094 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104272024-11-14T09:10:27.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 35c19774-c19d-40bb-974d-3402d51f2094 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104282024-11-14T09:10:27.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 35c19774-c19d-40bb-974d-3402d51f2094 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104292024-11-14T09:10:28.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 94b15a60-e753-4eab-a0ea-478e7ee55f95 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104302024-11-14T09:10:28.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 94b15a60-e753-4eab-a0ea-478e7ee55f95 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104312024-11-14T09:10:28.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = afab4319-3563-411b-9356-19f1d2bcc10e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104322024-11-14T09:10:28.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = afab4319-3563-411b-9356-19f1d2bcc10e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104332024-11-14T09:10:28.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = afab4319-3563-411b-9356-19f1d2bcc10e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104342024-11-14T09:10:28.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 94b15a60-e753-4eab-a0ea-478e7ee55f95 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104352024-11-14T09:10:29.052ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 0a69ed12-8d82-4dd1-8266-8dc4a152d31c response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
104362024-11-14T09:10:29.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1c2a30b-9885-4bdc-9df2-ee0ae460387e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104372024-11-14T09:10:29.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1c2a30b-9885-4bdc-9df2-ee0ae460387e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104382024-11-14T09:10:29.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a1c2a30b-9885-4bdc-9df2-ee0ae460387e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104392024-11-14T09:10:30.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc9e18dc-c357-4f22-b427-f388d4a9abbe roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104402024-11-14T09:10:30.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc9e18dc-c357-4f22-b427-f388d4a9abbe resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104412024-11-14T09:10:30.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc9e18dc-c357-4f22-b427-f388d4a9abbe response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104422024-11-14T09:10:31.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6510e434-6114-4c6e-ad91-2cf435253402 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104432024-11-14T09:10:31.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6510e434-6114-4c6e-ad91-2cf435253402 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104442024-11-14T09:10:31.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6510e434-6114-4c6e-ad91-2cf435253402 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104452024-11-14T09:10:32.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b398348-5384-4dea-8648-d9daa7a6e68e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104462024-11-14T09:10:32.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b398348-5384-4dea-8648-d9daa7a6e68e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104472024-11-14T09:10:32.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b398348-5384-4dea-8648-d9daa7a6e68e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104482024-11-14T09:10:33.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bcc2653f-9bdd-430c-8812-8ccccdf05787 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104492024-11-14T09:10:33.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bcc2653f-9bdd-430c-8812-8ccccdf05787 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104502024-11-14T09:10:33.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bcc2653f-9bdd-430c-8812-8ccccdf05787 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104512024-11-14T09:10:34.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 7f3ea331-30c0-45fd-bd54-ae9da8612b13 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
104522024-11-14T09:10:34.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 7f3ea331-30c0-45fd-bd54-ae9da8612b13 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
104532024-11-14T09:10:34.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 7f3ea331-30c0-45fd-bd54-ae9da8612b13 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
104542024-11-14T09:10:34.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 51e8f973-f731-460a-9d61-4b8b9e5e285f roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
104552024-11-14T09:10:34.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 51e8f973-f731-460a-9d61-4b8b9e5e285f resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
104562024-11-14T09:10:34.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51506 req_id = 51e8f973-f731-460a-9d61-4b8b9e5e285f response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
104572024-11-14T09:10:34.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b4ab6d50-5bd4-4e07-bdf3-ec526aff7ef6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104582024-11-14T09:10:34.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b4ab6d50-5bd4-4e07-bdf3-ec526aff7ef6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104592024-11-14T09:10:34.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b4ab6d50-5bd4-4e07-bdf3-ec526aff7ef6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104602024-11-14T09:10:35.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c72fa742-e130-4bc3-b7e0-bf1f23c0778b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104612024-11-14T09:10:35.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c72fa742-e130-4bc3-b7e0-bf1f23c0778b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104622024-11-14T09:10:35.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c72fa742-e130-4bc3-b7e0-bf1f23c0778b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
104632024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
104642024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104652024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
104662024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
104672024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104682024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
104692024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
104702024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
104712024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104722024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104732024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104742024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
104752024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104762024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
104772024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104782024-11-14T09:10:35.534ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104792024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104802024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
104812024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104822024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
104832024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
104842024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104852024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
104862024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104872024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104882024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
104892024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104902024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104912024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104922024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104932024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104942024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104952024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104962024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104972024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104982024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104992024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105002024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105012024-11-14T09:10:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105022024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
105032024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105042024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
105052024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105062024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
105072024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105082024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
105092024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105102024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105112024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105122024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105132024-11-14T09:10:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105142024-11-14T09:10:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105152024-11-14T09:10:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105162024-11-14T09:10:35.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105172024-11-14T09:10:35.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105182024-11-14T09:10:35.537ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.376674ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105192024-11-14T09:10:35.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105202024-11-14T09:10:35.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105212024-11-14T09:10:35.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105222024-11-14T09:10:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105232024-11-14T09:10:35.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105242024-11-14T09:10:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105252024-11-14T09:10:35.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105262024-11-14T09:10:35.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105272024-11-14T09:10:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105282024-11-14T09:10:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105292024-11-14T09:10:35.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105302024-11-14T09:10:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105312024-11-14T09:10:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105322024-11-14T09:10:35.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105332024-11-14T09:10:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105342024-11-14T09:10:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105352024-11-14T09:10:35.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105362024-11-14T09:10:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105372024-11-14T09:10:35.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1843, tv_nsec: 327757088 } })
105382024-11-14T09:10:35.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105392024-11-14T09:10:35.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
105402024-11-14T09:10:35.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1843, tv_nsec: 329302493 } })
105412024-11-14T09:10:35.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
105422024-11-14T09:10:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105432024-11-14T09:10:35.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105442024-11-14T09:10:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105452024-11-14T09:10:35.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1843, tv_nsec: 336785823 } })
105462024-11-14T09:10:35.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105472024-11-14T09:10:35.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
105482024-11-14T09:10:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105492024-11-14T09:10:35.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105502024-11-14T09:10:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105512024-11-14T09:10:35.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105522024-11-14T09:10:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105532024-11-14T09:10:35.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105542024-11-14T09:10:35.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105552024-11-14T09:10:35.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105562024-11-14T09:10:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105572024-11-14T09:10:35.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.848598ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
105582024-11-14T09:10:35.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105592024-11-14T09:10:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105602024-11-14T09:10:35.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105612024-11-14T09:10:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105622024-11-14T09:10:35.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105632024-11-14T09:10:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105642024-11-14T09:10:35.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105652024-11-14T09:10:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105662024-11-14T09:10:35.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105672024-11-14T09:10:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105682024-11-14T09:10:35.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105692024-11-14T09:10:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105702024-11-14T09:10:35.594ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105712024-11-14T09:10:35.594ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105722024-11-14T09:10:35.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105732024-11-14T09:10:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105742024-11-14T09:10:35.595ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105752024-11-14T09:10:35.595ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.268025ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
105762024-11-14T09:10:35.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.109205ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
105772024-11-14T09:10:35.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105782024-11-14T09:10:35.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105792024-11-14T09:10:35.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105802024-11-14T09:10:35.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105812024-11-14T09:10:35.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.72676ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105822024-11-14T09:10:35.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105832024-11-14T09:10:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
105842024-11-14T09:10:35.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105852024-11-14T09:10:35.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105862024-11-14T09:10:35.602ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.826576ms iteration = 26 status = 0
105872024-11-14T09:10:35.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105882024-11-14T09:10:35.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105892024-11-14T09:10:35.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105902024-11-14T09:10:35.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105912024-11-14T09:10:35.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105922024-11-14T09:10:35.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
105932024-11-14T09:10:35.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105942024-11-14T09:10:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105952024-11-14T09:10:35.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105962024-11-14T09:10:35.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105972024-11-14T09:10:35.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105982024-11-14T09:10:35.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105992024-11-14T09:10:35.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 87.059639ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106002024-11-14T09:10:35.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.390516ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106012024-11-14T09:10:35.626ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106022024-11-14T09:10:35.626ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106032024-11-14T09:10:35.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106042024-11-14T09:10:35.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106052024-11-14T09:10:35.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.614088ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106062024-11-14T09:10:35.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
106072024-11-14T09:10:35.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106082024-11-14T09:10:35.661ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1154eebd-5c68-47e9-a4d3-489ad57e2e9e", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106092024-11-14T09:10:35.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106102024-11-14T09:10:35.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
106112024-11-14T09:10:35.716ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106122024-11-14T09:10:35.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106132024-11-14T09:10:35.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f82eeb42-8d6c-42b0-b270-2bacbc748f8c", "content-length": "372", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106142024-11-14T09:10:35.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106152024-11-14T09:10:35.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106162024-11-14T09:10:35.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106172024-11-14T09:10:35.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106182024-11-14T09:10:35.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106192024-11-14T09:10:35.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106202024-11-14T09:10:35.729ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
106212024-11-14T09:10:35.729ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 195.185216ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
106222024-11-14T09:10:35.751ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106232024-11-14T09:10:35.751ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106242024-11-14T09:10:35.751ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 217.688537ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106252024-11-14T09:10:35.756ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 222.277011ms iteration = 30 status = {"physical_disks_added":0}
106262024-11-14T09:10:35.766ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
106272024-11-14T09:10:35.766ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106282024-11-14T09:10:35.766ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "51c468f0-382f-4cd2-8258-6925ecf9830e", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106292024-11-14T09:10:35.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106302024-11-14T09:10:35.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106312024-11-14T09:10:35.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106322024-11-14T09:10:35.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106332024-11-14T09:10:35.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106342024-11-14T09:10:35.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106352024-11-14T09:10:35.779ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106362024-11-14T09:10:35.779ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106372024-11-14T09:10:35.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
106382024-11-14T09:10:35.805ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106392024-11-14T09:10:35.806ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81ac806b-9db3-4cbd-8614-dd149f1b53a4", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106402024-11-14T09:10:35.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106412024-11-14T09:10:35.807ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106422024-11-14T09:10:35.812ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
106432024-11-14T09:10:35.812ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106442024-11-14T09:10:35.812ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9cc18f0-ec39-4c82-bb1e-e431c4703a4c", "content-length": "26", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106452024-11-14T09:10:35.812ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106462024-11-14T09:10:35.814ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106472024-11-14T09:10:35.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a35d62ca-bea2-48ee-beff-c6175f779432", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106482024-11-14T09:10:35.882ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 348.431858ms iteration = 28 status = {}
106492024-11-14T09:10:35.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106502024-11-14T09:10:35.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19149367-4a42-4926-925e-2ab4aefd40ec", "content-length": "691", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106512024-11-14T09:10:35.883ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
106522024-11-14T09:10:35.883ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
106532024-11-14T09:10:35.883ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
106542024-11-14T09:10:35.886ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 352.064906ms iteration = 27 status = {}
106552024-11-14T09:10:35.895ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106562024-11-14T09:10:35.896ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "712491cd-df6d-4fda-afa4-2da4cd15ec5e", "content-length": "2", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106572024-11-14T09:10:35.897ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106582024-11-14T09:10:35.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106592024-11-14T09:10:35.899ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 365.056505ms iteration = 26 status = null
106602024-11-14T09:10:35.901ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.967756ms iteration = 26 status = {}
106612024-11-14T09:10:35.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106622024-11-14T09:10:35.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106632024-11-14T09:10:35.948ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
106642024-11-14T09:10:35.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106652024-11-14T09:10:35.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106662024-11-14T09:10:35.957ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106672024-11-14T09:10:35.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb8f565c-926a-4d5c-a9b8-79bed20a0579", "content-length": "134", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106682024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106692024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
106702024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106712024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106722024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106732024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106742024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106752024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106762024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106772024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106782024-11-14T09:10:35.958ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
106792024-11-14T09:10:35.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106802024-11-14T09:10:35.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106812024-11-14T09:10:35.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106822024-11-14T09:10:35.960ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e85c0fff-6dbc-47d1-b260-8c6e3779b8a6", "content-length": "2", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106832024-11-14T09:10:35.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106842024-11-14T09:10:35.960ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dbfffb4-ed55-410f-b27a-187991678172", "content-length": "52", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106852024-11-14T09:10:35.960ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
106862024-11-14T09:10:35.960ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106872024-11-14T09:10:36.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "89cc4c6e-eeea-4e33-80f6-66c80cee10ba", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106882024-11-14T09:10:36.059ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
106892024-11-14T09:10:36.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
106902024-11-14T09:10:36.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5b11858-e84c-48bf-92b7-6329e2afb9cd", "content-length": "682", "date": "Thu, 14 Nov 2024 09:10:35 GMT"} })
106912024-11-14T09:10:36.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106922024-11-14T09:10:36.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106932024-11-14T09:10:36.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106942024-11-14T09:10:36.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106952024-11-14T09:10:36.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106962024-11-14T09:10:36.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106972024-11-14T09:10:36.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106982024-11-14T09:10:36.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106992024-11-14T09:10:36.077ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 543.086635ms iteration = 26 status = {}
107002024-11-14T09:10:36.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ca94c91-05d6-46e0-b867-00c51be60907 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107012024-11-14T09:10:36.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ca94c91-05d6-46e0-b867-00c51be60907 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107022024-11-14T09:10:36.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ca94c91-05d6-46e0-b867-00c51be60907 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107032024-11-14T09:10:37.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6895b310-2630-47de-92e7-a28c65a6d8af roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107042024-11-14T09:10:37.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6895b310-2630-47de-92e7-a28c65a6d8af resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107052024-11-14T09:10:37.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6895b310-2630-47de-92e7-a28c65a6d8af response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107062024-11-14T09:10:38.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f243333b-96e3-43b1-8c9c-512445bda3e0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107072024-11-14T09:10:38.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f243333b-96e3-43b1-8c9c-512445bda3e0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107082024-11-14T09:10:38.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f243333b-96e3-43b1-8c9c-512445bda3e0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107092024-11-14T09:10:39.167ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61731
107102024-11-14T09:10:39.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61731 req_id = 35aab587-bb68-4a0e-addc-eecd3ec3f4f5 roles = RoleSet { roles: {} } uri = /metrics/producers
107112024-11-14T09:10:39.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61731 req_id = 35aab587-bb68-4a0e-addc-eecd3ec3f4f5 resource = Database result = Ok(()) uri = /metrics/producers
107122024-11-14T09:10:39.202ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 90e4e05f-b4bf-4b2e-9770-f73b3d2c05fa
107132024-11-14T09:10:39.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34910 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61731 req_id = 35aab587-bb68-4a0e-addc-eecd3ec3f4f5 response_code = 201 uri = /metrics/producers
107142024-11-14T09:10:39.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 601bf3a5-4b91-4053-b24f-b348c5604d0e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107152024-11-14T09:10:39.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 601bf3a5-4b91-4053-b24f-b348c5604d0e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107162024-11-14T09:10:39.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 601bf3a5-4b91-4053-b24f-b348c5604d0e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107172024-11-14T09:10:39.913ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62924
107182024-11-14T09:10:39.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62924 req_id = dcd35784-2cdc-4c55-972d-567ccf3a8ee7 roles = RoleSet { roles: {} } uri = /metrics/producers
107192024-11-14T09:10:39.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62924 req_id = dcd35784-2cdc-4c55-972d-567ccf3a8ee7 resource = Database result = Ok(()) uri = /metrics/producers
107202024-11-14T09:10:39.948ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 0a0adcc5-bcdd-46d2-a222-ace3abfe409c
107212024-11-14T09:10:39.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35023 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62924 req_id = dcd35784-2cdc-4c55-972d-567ccf3a8ee7 response_code = 201 uri = /metrics/producers
107222024-11-14T09:10:40.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f65a3495-d3df-4a55-a918-dd755d6c7b00 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107232024-11-14T09:10:40.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f65a3495-d3df-4a55-a918-dd755d6c7b00 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107242024-11-14T09:10:40.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f65a3495-d3df-4a55-a918-dd755d6c7b00 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107252024-11-14T09:10:41.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 698982c9-4799-4af3-9fbb-491577955767 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107262024-11-14T09:10:41.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 698982c9-4799-4af3-9fbb-491577955767 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107272024-11-14T09:10:41.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 698982c9-4799-4af3-9fbb-491577955767 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107282024-11-14T09:10:42.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1e0064c-b01f-4815-8998-759cad474a12 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107292024-11-14T09:10:42.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1e0064c-b01f-4815-8998-759cad474a12 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107302024-11-14T09:10:42.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1e0064c-b01f-4815-8998-759cad474a12 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107312024-11-14T09:10:43.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8ca89ee8-1c8f-4a3c-a8de-83d391f4dcfc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107322024-11-14T09:10:43.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8ca89ee8-1c8f-4a3c-a8de-83d391f4dcfc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107332024-11-14T09:10:43.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8ca89ee8-1c8f-4a3c-a8de-83d391f4dcfc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107342024-11-14T09:10:44.052ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 47c3ef90-08cc-4e37-810e-451238a498ef response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
107352024-11-14T09:10:44.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12fff9b5-ae9f-456f-87e5-f732ac61b9e8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107362024-11-14T09:10:44.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12fff9b5-ae9f-456f-87e5-f732ac61b9e8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107372024-11-14T09:10:44.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12fff9b5-ae9f-456f-87e5-f732ac61b9e8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107382024-11-14T09:10:45.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0c314100-4e77-46ef-9f1d-df5c4ea99a0c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107392024-11-14T09:10:45.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0c314100-4e77-46ef-9f1d-df5c4ea99a0c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107402024-11-14T09:10:45.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0c314100-4e77-46ef-9f1d-df5c4ea99a0c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107412024-11-14T09:10:45.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
107422024-11-14T09:10:45.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
107432024-11-14T09:10:45.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107442024-11-14T09:10:45.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107452024-11-14T09:10:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107462024-11-14T09:10:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107472024-11-14T09:10:45.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107482024-11-14T09:10:45.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107492024-11-14T09:10:45.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107502024-11-14T09:10:45.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107512024-11-14T09:10:45.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107522024-11-14T09:10:45.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107532024-11-14T09:10:45.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107542024-11-14T09:10:45.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107552024-11-14T09:10:45.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.156619ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107562024-11-14T09:10:45.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107572024-11-14T09:10:45.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
107582024-11-14T09:10:45.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107592024-11-14T09:10:45.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107602024-11-14T09:10:45.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
107612024-11-14T09:10:45.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.452389ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
107622024-11-14T09:10:45.834ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:41926
107632024-11-14T09:10:45.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41926 req_id = e1e861c0-294f-4df4-9761-796776903727 roles = RoleSet { roles: {} } uri = /metrics/producers
107642024-11-14T09:10:45.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41926 req_id = e1e861c0-294f-4df4-9761-796776903727 resource = Database result = Ok(()) uri = /metrics/producers
107652024-11-14T09:10:45.845ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 4ceca43a-03cf-4e69-8d70-2c7628b44304
107662024-11-14T09:10:45.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11385 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41926 req_id = e1e861c0-294f-4df4-9761-796776903727 response_code = 201 uri = /metrics/producers
107672024-11-14T09:10:46.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e26c0f26-12ca-47a7-847b-ec8e882f3c4d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107682024-11-14T09:10:46.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e26c0f26-12ca-47a7-847b-ec8e882f3c4d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107692024-11-14T09:10:46.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e26c0f26-12ca-47a7-847b-ec8e882f3c4d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107702024-11-14T09:10:47.246ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:55383
107712024-11-14T09:10:47.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55383 req_id = c8cdc7ef-8c34-47f5-b69c-df8ac97eb1d6 roles = RoleSet { roles: {} } uri = /metrics/producers
107722024-11-14T09:10:47.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55383 req_id = c8cdc7ef-8c34-47f5-b69c-df8ac97eb1d6 resource = Database result = Ok(()) uri = /metrics/producers
107732024-11-14T09:10:47.253ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 65d2236a-3110-4d84-aa25-77e21779db87
107742024-11-14T09:10:47.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7531 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55383 req_id = c8cdc7ef-8c34-47f5-b69c-df8ac97eb1d6 response_code = 201 uri = /metrics/producers
107752024-11-14T09:10:47.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e9dabef8-e9e1-4d2b-a911-0bdefd3fbcbb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107762024-11-14T09:10:47.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e9dabef8-e9e1-4d2b-a911-0bdefd3fbcbb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107772024-11-14T09:10:47.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e9dabef8-e9e1-4d2b-a911-0bdefd3fbcbb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107782024-11-14T09:10:48.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8118d03a-6ac7-445d-9311-60b5d3fb66f6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107792024-11-14T09:10:48.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8118d03a-6ac7-445d-9311-60b5d3fb66f6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107802024-11-14T09:10:48.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8118d03a-6ac7-445d-9311-60b5d3fb66f6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107812024-11-14T09:10:48.824ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52974
107822024-11-14T09:10:48.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52974 req_id = f78ad54e-5106-454c-8ad9-0639d067a9ef roles = RoleSet { roles: {} } uri = /metrics/producers
107832024-11-14T09:10:48.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52974 req_id = f78ad54e-5106-454c-8ad9-0639d067a9ef resource = Database result = Ok(()) uri = /metrics/producers
107842024-11-14T09:10:48.833ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 92786f50-3ada-49c6-9f91-967466d8804f
107852024-11-14T09:10:48.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9243 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52974 req_id = f78ad54e-5106-454c-8ad9-0639d067a9ef response_code = 201 uri = /metrics/producers
107862024-11-14T09:10:49.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0d800e97-27ee-49d8-a06e-0ba6e59b5d9e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107872024-11-14T09:10:49.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0d800e97-27ee-49d8-a06e-0ba6e59b5d9e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107882024-11-14T09:10:49.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0d800e97-27ee-49d8-a06e-0ba6e59b5d9e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107892024-11-14T09:10:50.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4a601259-ba2f-421d-a357-d56d109ca85e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107902024-11-14T09:10:50.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4a601259-ba2f-421d-a357-d56d109ca85e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107912024-11-14T09:10:50.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4a601259-ba2f-421d-a357-d56d109ca85e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
107922024-11-14T09:10:50.924ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49760
107932024-11-14T09:10:50.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49760 req_id = 0b42102a-490d-471b-ba9f-e3ea497eae59 roles = RoleSet { roles: {} } uri = /metrics/producers
107942024-11-14T09:10:50.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49760 req_id = 0b42102a-490d-471b-ba9f-e3ea497eae59 resource = Database result = Ok(()) uri = /metrics/producers
107952024-11-14T09:10:50.964ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = c91f550b-068d-4077-a493-b226555a9b58
107962024-11-14T09:10:50.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39370 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49760 req_id = 0b42102a-490d-471b-ba9f-e3ea497eae59 response_code = 201 uri = /metrics/producers
107972024-11-14T09:10:51.291ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
107982024-11-14T09:10:51.291ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
107992024-11-14T09:10:51.322ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
108002024-11-14T09:10:51.322ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62908
108012024-11-14T09:10:51.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62908 req_id = ddaf7bc2-c3af-46b4-8d1d-70e70db140a8 roles = RoleSet { roles: {} } uri = /metrics/producers
108022024-11-14T09:10:51.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62908 req_id = ddaf7bc2-c3af-46b4-8d1d-70e70db140a8 resource = Database result = Ok(()) uri = /metrics/producers
108032024-11-14T09:10:51.365ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 484a1c50-302f-49ec-9214-2179c2ff7104
108042024-11-14T09:10:51.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42912 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62908 req_id = ddaf7bc2-c3af-46b4-8d1d-70e70db140a8 response_code = 201 uri = /metrics/producers
108052024-11-14T09:10:51.365ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ddaf7bc2-c3af-46b4-8d1d-70e70db140a8", "content-length": "41", "date": "Thu, 14 Nov 2024 09:10:50 GMT"} })
108062024-11-14T09:10:51.366ZDEBGnexus (producer-registration-task): registered with nexus successfully
108072024-11-14T09:10:51.366ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
108082024-11-14T09:10:51.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 424705e0-c804-40b4-b1bc-b8e8d877d216 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108092024-11-14T09:10:51.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 424705e0-c804-40b4-b1bc-b8e8d877d216 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108102024-11-14T09:10:51.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 424705e0-c804-40b4-b1bc-b8e8d877d216 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108112024-11-14T09:10:52.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 303878a4-2b98-4c92-8814-25c9cc414e93 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108122024-11-14T09:10:52.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 303878a4-2b98-4c92-8814-25c9cc414e93 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108132024-11-14T09:10:52.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 303878a4-2b98-4c92-8814-25c9cc414e93 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108142024-11-14T09:10:53.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4ee8dc17-552a-4ccf-8779-6ca93521de69 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108152024-11-14T09:10:53.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4ee8dc17-552a-4ccf-8779-6ca93521de69 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108162024-11-14T09:10:53.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4ee8dc17-552a-4ccf-8779-6ca93521de69 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108172024-11-14T09:10:54.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2352b9f6-2984-4299-b4cf-d7e1eb7b76cf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108182024-11-14T09:10:54.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2352b9f6-2984-4299-b4cf-d7e1eb7b76cf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108192024-11-14T09:10:54.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2352b9f6-2984-4299-b4cf-d7e1eb7b76cf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108202024-11-14T09:10:55.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
108212024-11-14T09:10:55.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
108222024-11-14T09:10:55.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108232024-11-14T09:10:55.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108242024-11-14T09:10:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108252024-11-14T09:10:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108262024-11-14T09:10:55.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108272024-11-14T09:10:55.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108282024-11-14T09:10:55.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108292024-11-14T09:10:55.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108302024-11-14T09:10:55.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108312024-11-14T09:10:55.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108322024-11-14T09:10:55.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108332024-11-14T09:10:55.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108342024-11-14T09:10:55.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108352024-11-14T09:10:55.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
108362024-11-14T09:10:55.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108372024-11-14T09:10:55.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108382024-11-14T09:10:55.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
108392024-11-14T09:10:55.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.588667ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
108402024-11-14T09:10:55.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.212901ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108412024-11-14T09:10:55.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7e94b610-6efa-421c-997e-6cd354b0db67 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108422024-11-14T09:10:55.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7e94b610-6efa-421c-997e-6cd354b0db67 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108432024-11-14T09:10:55.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7e94b610-6efa-421c-997e-6cd354b0db67 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108442024-11-14T09:10:56.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d78df7b8-2e38-4885-8bb4-732cab7ab267 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108452024-11-14T09:10:56.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d78df7b8-2e38-4885-8bb4-732cab7ab267 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108462024-11-14T09:10:56.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d78df7b8-2e38-4885-8bb4-732cab7ab267 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108472024-11-14T09:10:57.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 60ca2807-a3e8-44cf-9d20-fc6f5e5017d4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108482024-11-14T09:10:57.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 60ca2807-a3e8-44cf-9d20-fc6f5e5017d4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108492024-11-14T09:10:57.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 60ca2807-a3e8-44cf-9d20-fc6f5e5017d4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108502024-11-14T09:10:58.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 88abfd81-7316-446c-b74b-c02ae6d32c76 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
108512024-11-14T09:10:58.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 88abfd81-7316-446c-b74b-c02ae6d32c76 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
108522024-11-14T09:10:58.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 88abfd81-7316-446c-b74b-c02ae6d32c76 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
108532024-11-14T09:10:58.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4db566b-c552-4db7-ab51-5a2ed1dc4c44 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108542024-11-14T09:10:58.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4db566b-c552-4db7-ab51-5a2ed1dc4c44 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108552024-11-14T09:10:58.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4db566b-c552-4db7-ab51-5a2ed1dc4c44 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108562024-11-14T09:10:59.051ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 028f0114-45a4-493e-be7c-18de81bd2a1a response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
108572024-11-14T09:10:59.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d5b8602-ffc5-4a6e-9a2a-d03f20d3b74b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108582024-11-14T09:10:59.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d5b8602-ffc5-4a6e-9a2a-d03f20d3b74b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108592024-11-14T09:10:59.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2d5b8602-ffc5-4a6e-9a2a-d03f20d3b74b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108602024-11-14T09:11:00.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb4bbbca-07b8-4ade-a360-577fcf8a9d1e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108612024-11-14T09:11:00.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb4bbbca-07b8-4ade-a360-577fcf8a9d1e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108622024-11-14T09:11:00.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb4bbbca-07b8-4ade-a360-577fcf8a9d1e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108632024-11-14T09:11:01.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5291388d-08cd-4d96-9127-343691e7b283 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108642024-11-14T09:11:01.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5291388d-08cd-4d96-9127-343691e7b283 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108652024-11-14T09:11:01.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5291388d-08cd-4d96-9127-343691e7b283 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108662024-11-14T09:11:02.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b5894c4-3ced-4eea-b49c-46d51df451ac roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108672024-11-14T09:11:02.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b5894c4-3ced-4eea-b49c-46d51df451ac resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108682024-11-14T09:11:02.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b5894c4-3ced-4eea-b49c-46d51df451ac response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108692024-11-14T09:11:03.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 52e39cd9-391c-4190-8354-a0a6a3fd7d70 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108702024-11-14T09:11:03.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 52e39cd9-391c-4190-8354-a0a6a3fd7d70 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108712024-11-14T09:11:03.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 52e39cd9-391c-4190-8354-a0a6a3fd7d70 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108722024-11-14T09:11:04.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1fc259fe-d32f-41d8-a372-1e1cfde39ef9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108732024-11-14T09:11:04.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1fc259fe-d32f-41d8-a372-1e1cfde39ef9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108742024-11-14T09:11:04.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1fc259fe-d32f-41d8-a372-1e1cfde39ef9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
108752024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
108762024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108772024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
108782024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
108792024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
108802024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108812024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108822024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
108832024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108842024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
108852024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
108862024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
108872024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108882024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108892024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
108902024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108912024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108922024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
108932024-11-14T09:11:05.534ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108942024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108952024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
108962024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
108972024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108982024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
108992024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
109002024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109012024-11-14T09:11:05.534ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
109022024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109032024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
109042024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
109052024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109062024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
109072024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
109082024-11-14T09:11:05.534ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 09:01:05.534391120 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
109092024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
109102024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
109112024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
109122024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109132024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
109142024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
109152024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
109162024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109172024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
109182024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109192024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
109202024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
109212024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109222024-11-14T09:11:05.534ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
109232024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109242024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.49\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
109252024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109262024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109272024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109282024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109292024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
109302024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109312024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109322024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109332024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109342024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109352024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109362024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109372024-11-14T09:11:05.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109382024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
109392024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109402024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
109412024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
109422024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
109432024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
109442024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
109452024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109462024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
109472024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109482024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109492024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
109502024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109512024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
109522024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
109532024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109542024-11-14T09:11:05.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1873, tv_nsec: 318526399 } })
109552024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109562024-11-14T09:11:05.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1873, tv_nsec: 318550100 } })
109572024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
109582024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
109592024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109602024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109612024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
109622024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
109632024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
109642024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.22959ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
109652024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
109662024-11-14T09:11:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.226089ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
109672024-11-14T09:11:05.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109682024-11-14T09:11:05.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109692024-11-14T09:11:05.538ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.460372ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
109702024-11-14T09:11:05.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109712024-11-14T09:11:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109722024-11-14T09:11:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109732024-11-14T09:11:05.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109742024-11-14T09:11:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109752024-11-14T09:11:05.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1873, tv_nsec: 323678382 } })
109762024-11-14T09:11:05.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
109772024-11-14T09:11:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
109782024-11-14T09:11:05.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109792024-11-14T09:11:05.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109802024-11-14T09:11:05.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109812024-11-14T09:11:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109822024-11-14T09:11:05.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109832024-11-14T09:11:05.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109842024-11-14T09:11:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109852024-11-14T09:11:05.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109862024-11-14T09:11:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109872024-11-14T09:11:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
109882024-11-14T09:11:05.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109892024-11-14T09:11:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109902024-11-14T09:11:05.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109912024-11-14T09:11:05.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1873, tv_nsec: 330584553 } })
109922024-11-14T09:11:05.547ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 09:01:05.534391120 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
109932024-11-14T09:11:05.547ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.055319ms iteration = 14 status = {"expiration":"2024-11-14T09:01:05.534391120Z","pruned":[]}
109942024-11-14T09:11:05.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
109952024-11-14T09:11:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109962024-11-14T09:11:05.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109972024-11-14T09:11:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109982024-11-14T09:11:05.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109992024-11-14T09:11:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110002024-11-14T09:11:05.551ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.610827ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
110012024-11-14T09:11:05.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.635026ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110022024-11-14T09:11:05.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110032024-11-14T09:11:05.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1873, tv_nsec: 339220172 } })
110042024-11-14T09:11:05.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
110052024-11-14T09:11:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110062024-11-14T09:11:05.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110072024-11-14T09:11:05.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110082024-11-14T09:11:05.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110092024-11-14T09:11:05.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110102024-11-14T09:11:05.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110112024-11-14T09:11:05.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110122024-11-14T09:11:05.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110132024-11-14T09:11:05.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110142024-11-14T09:11:05.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110152024-11-14T09:11:05.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110162024-11-14T09:11:05.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.32679ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
110172024-11-14T09:11:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110182024-11-14T09:11:05.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110192024-11-14T09:11:05.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110202024-11-14T09:11:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110212024-11-14T09:11:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110222024-11-14T09:11:05.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110232024-11-14T09:11:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110242024-11-14T09:11:05.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110252024-11-14T09:11:05.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.408543ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
110262024-11-14T09:11:05.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110272024-11-14T09:11:05.613ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
110282024-11-14T09:11:05.613ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
110292024-11-14T09:11:05.613ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.181672ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
110302024-11-14T09:11:05.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
110312024-11-14T09:11:05.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110322024-11-14T09:11:05.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110332024-11-14T09:11:05.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110342024-11-14T09:11:05.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110352024-11-14T09:11:05.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110362024-11-14T09:11:05.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110372024-11-14T09:11:05.615ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
110382024-11-14T09:11:05.615ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
110392024-11-14T09:11:05.615ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.860959ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
110402024-11-14T09:11:05.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110412024-11-14T09:11:05.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110422024-11-14T09:11:05.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110432024-11-14T09:11:05.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110442024-11-14T09:11:05.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110452024-11-14T09:11:05.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110462024-11-14T09:11:05.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110472024-11-14T09:11:05.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110482024-11-14T09:11:05.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110492024-11-14T09:11:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110502024-11-14T09:11:05.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110512024-11-14T09:11:05.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.451359ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
110522024-11-14T09:11:05.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110532024-11-14T09:11:05.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110542024-11-14T09:11:05.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110552024-11-14T09:11:05.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
110562024-11-14T09:11:05.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.901537ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
110572024-11-14T09:11:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
110582024-11-14T09:11:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110592024-11-14T09:11:05.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110602024-11-14T09:11:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110612024-11-14T09:11:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
110622024-11-14T09:11:05.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110632024-11-14T09:11:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110642024-11-14T09:11:05.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110652024-11-14T09:11:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110662024-11-14T09:11:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110672024-11-14T09:11:05.630ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.423939ms iteration = 27 status = 0
110682024-11-14T09:11:05.660ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110692024-11-14T09:11:05.660ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
110702024-11-14T09:11:05.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110712024-11-14T09:11:05.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110722024-11-14T09:11:05.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110732024-11-14T09:11:05.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110742024-11-14T09:11:05.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110752024-11-14T09:11:05.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110762024-11-14T09:11:05.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110772024-11-14T09:11:05.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110782024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
110792024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
110802024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
110812024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110822024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110832024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110842024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110852024-11-14T09:11:05.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110862024-11-14T09:11:05.671ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
110872024-11-14T09:11:05.671ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
110882024-11-14T09:11:05.671ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
110892024-11-14T09:11:05.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110902024-11-14T09:11:05.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.507949ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110912024-11-14T09:11:05.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110922024-11-14T09:11:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
110932024-11-14T09:11:05.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110942024-11-14T09:11:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110952024-11-14T09:11:05.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110962024-11-14T09:11:05.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110972024-11-14T09:11:05.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110982024-11-14T09:11:05.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110992024-11-14T09:11:05.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111002024-11-14T09:11:05.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111012024-11-14T09:11:05.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
111022024-11-14T09:11:05.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 172.202436ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
111032024-11-14T09:11:05.712ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
111042024-11-14T09:11:05.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111052024-11-14T09:11:05.726ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111062024-11-14T09:11:05.726ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
111072024-11-14T09:11:05.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111082024-11-14T09:11:05.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111092024-11-14T09:11:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111102024-11-14T09:11:05.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111112024-11-14T09:11:05.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111122024-11-14T09:11:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111132024-11-14T09:11:05.730ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
111142024-11-14T09:11:05.730ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
111152024-11-14T09:11:05.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111162024-11-14T09:11:05.730ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111172024-11-14T09:11:05.730ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
111182024-11-14T09:11:05.730ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.455457ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
111192024-11-14T09:11:05.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111202024-11-14T09:11:05.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 196.321494ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
111212024-11-14T09:11:05.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111222024-11-14T09:11:05.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111232024-11-14T09:11:05.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111242024-11-14T09:11:05.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111252024-11-14T09:11:05.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111262024-11-14T09:11:05.735ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
111272024-11-14T09:11:05.735ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
111282024-11-14T09:11:05.735ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
111292024-11-14T09:11:05.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 200.932129ms iteration = 15 status = {"generation":1}
111302024-11-14T09:11:05.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111312024-11-14T09:11:05.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111322024-11-14T09:11:05.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111332024-11-14T09:11:05.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111342024-11-14T09:11:05.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111352024-11-14T09:11:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111362024-11-14T09:11:05.738ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
111372024-11-14T09:11:05.738ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
111382024-11-14T09:11:05.738ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
111392024-11-14T09:11:05.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 203.700282ms iteration = 15 status = {"generation":2}
111402024-11-14T09:11:05.753ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 219.333314ms iteration = 31 status = {"physical_disks_added":0}
111412024-11-14T09:11:05.782ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
111422024-11-14T09:11:05.782ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 247.647279ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
111432024-11-14T09:11:05.783ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
111442024-11-14T09:11:05.783ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 248.532113ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
111452024-11-14T09:11:05.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111462024-11-14T09:11:05.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111472024-11-14T09:11:05.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111482024-11-14T09:11:05.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111492024-11-14T09:11:05.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111502024-11-14T09:11:05.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111512024-11-14T09:11:05.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111522024-11-14T09:11:05.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111532024-11-14T09:11:05.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111542024-11-14T09:11:05.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111552024-11-14T09:11:05.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
111562024-11-14T09:11:05.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
111572024-11-14T09:11:05.873ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111582024-11-14T09:11:05.873ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ce559ed-a8fc-4dea-9c3b-a3529f049d99", "content-length": "26", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
111592024-11-14T09:11:05.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111602024-11-14T09:11:05.874ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111612024-11-14T09:11:05.880ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
111622024-11-14T09:11:05.880ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111632024-11-14T09:11:05.880ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d176aa51-524d-49a7-a865-af5024154a96", "content-length": "26", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
111642024-11-14T09:11:05.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111652024-11-14T09:11:05.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
111662024-11-14T09:11:05.914ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111672024-11-14T09:11:05.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111682024-11-14T09:11:05.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
111692024-11-14T09:11:05.933ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111702024-11-14T09:11:05.933ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b870590b-e4a5-4b78-8272-8d0df9755663", "content-length": "26", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
111712024-11-14T09:11:05.933ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111722024-11-14T09:11:05.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111732024-11-14T09:11:05.940ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
111742024-11-14T09:11:05.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 904a602b-872a-4589-abea-ebc3411476b7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
111752024-11-14T09:11:05.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 904a602b-872a-4589-abea-ebc3411476b7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
111762024-11-14T09:11:05.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 904a602b-872a-4589-abea-ebc3411476b7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
111772024-11-14T09:11:05.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1552746d-9044-432b-b519-f165b2bbd0ee", "content-length": "372", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
111782024-11-14T09:11:05.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111792024-11-14T09:11:05.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111802024-11-14T09:11:05.996ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
111812024-11-14T09:11:05.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111822024-11-14T09:11:05.997ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "356ae654-cd7c-40c3-a203-6cf0cb008814", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
111832024-11-14T09:11:05.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111842024-11-14T09:11:05.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111852024-11-14T09:11:06.048ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
111862024-11-14T09:11:06.049ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cd5d8fbd-d0ed-4eef-8deb-db5fe232c366", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111872024-11-14T09:11:06.049ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111882024-11-14T09:11:06.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fade7325-5ba6-41f3-805c-1b30f87366fa", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111892024-11-14T09:11:06.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111902024-11-14T09:11:06.051ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111912024-11-14T09:11:06.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 517.667546ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
111922024-11-14T09:11:06.089ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 555.527415ms iteration = 27 status = {}
111932024-11-14T09:11:06.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
111942024-11-14T09:11:06.111ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "43bb9f68-88b0-45a8-b6ca-3855e5ca627c", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
111952024-11-14T09:11:06.111ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
111962024-11-14T09:11:06.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bd032807-7692-4baf-8271-5d6f2cfcc5b9", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
111972024-11-14T09:11:06.113ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
111982024-11-14T09:11:06.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111992024-11-14T09:11:06.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da62e50-a3d4-45fb-ac58-65b6b3278e3f", "content-length": "691", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112002024-11-14T09:11:06.114ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
112012024-11-14T09:11:06.114ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
112022024-11-14T09:11:06.114ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
112032024-11-14T09:11:06.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112042024-11-14T09:11:06.116ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e485785f-4aa1-4042-85ee-8b95e0cde8c0", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112052024-11-14T09:11:06.116ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112062024-11-14T09:11:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112072024-11-14T09:11:06.116ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 582.473118ms iteration = 28 status = {}
112082024-11-14T09:11:06.118ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
112092024-11-14T09:11:06.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 584.48371ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
112102024-11-14T09:11:06.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112112024-11-14T09:11:06.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112122024-11-14T09:11:06.122ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112132024-11-14T09:11:06.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112142024-11-14T09:11:06.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a3f318cc-2101-4fa4-927e-60a34db99e3e", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112152024-11-14T09:11:06.125ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 590.72863ms iteration = 29 status = {}
112162024-11-14T09:11:06.127ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112172024-11-14T09:11:06.128ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "159c158a-280f-4ad2-bc30-e3ea67a7df40", "content-length": "2", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112182024-11-14T09:11:06.129ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112192024-11-14T09:11:06.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112202024-11-14T09:11:06.131ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 597.026552ms iteration = 27 status = null
112212024-11-14T09:11:06.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112222024-11-14T09:11:06.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112232024-11-14T09:11:06.176ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
112242024-11-14T09:11:06.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112252024-11-14T09:11:06.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112262024-11-14T09:11:06.185ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112272024-11-14T09:11:06.185ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c9f342b-e82d-401b-b9ac-2facba8c5233", "content-length": "134", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112282024-11-14T09:11:06.185ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112292024-11-14T09:11:06.185ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
112302024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112312024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112322024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112332024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112342024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112352024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112362024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112372024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112382024-11-14T09:11:06.186ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
112392024-11-14T09:11:06.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112402024-11-14T09:11:06.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112412024-11-14T09:11:06.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112422024-11-14T09:11:06.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f86b28bc-26a8-4963-a0d5-1098db31821e", "content-length": "2", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112432024-11-14T09:11:06.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112442024-11-14T09:11:06.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a94da8ca-23aa-438b-bd2a-80adf6791116", "content-length": "52", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112452024-11-14T09:11:06.189ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
112462024-11-14T09:11:06.189ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112472024-11-14T09:11:06.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5cf8ae4f-acb8-470a-bc27-723a73d65deb", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112482024-11-14T09:11:06.295ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
112492024-11-14T09:11:06.295ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112502024-11-14T09:11:06.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e68376dc-71a3-468c-9061-299d0950bd76", "content-length": "682", "date": "Thu, 14 Nov 2024 09:11:05 GMT"} })
112512024-11-14T09:11:06.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112522024-11-14T09:11:06.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112532024-11-14T09:11:06.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112542024-11-14T09:11:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112552024-11-14T09:11:06.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112562024-11-14T09:11:06.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112572024-11-14T09:11:06.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112582024-11-14T09:11:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112592024-11-14T09:11:06.313ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 778.908004ms iteration = 27 status = {}
112602024-11-14T09:11:06.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8669d591-f406-4dc3-8286-442b61e3b340 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112612024-11-14T09:11:06.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8669d591-f406-4dc3-8286-442b61e3b340 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112622024-11-14T09:11:07.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8669d591-f406-4dc3-8286-442b61e3b340 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112632024-11-14T09:11:08.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9a22a679-58c7-4257-b6a0-63994514818e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112642024-11-14T09:11:08.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9a22a679-58c7-4257-b6a0-63994514818e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112652024-11-14T09:11:08.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9a22a679-58c7-4257-b6a0-63994514818e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112662024-11-14T09:11:09.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca4a00e7-e1c5-4075-b05f-5697dcb371e2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112672024-11-14T09:11:09.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca4a00e7-e1c5-4075-b05f-5697dcb371e2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112682024-11-14T09:11:09.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca4a00e7-e1c5-4075-b05f-5697dcb371e2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112692024-11-14T09:11:10.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 258fa567-a04c-4d56-8f13-1e47820df652 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112702024-11-14T09:11:10.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 258fa567-a04c-4d56-8f13-1e47820df652 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112712024-11-14T09:11:10.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 258fa567-a04c-4d56-8f13-1e47820df652 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112722024-11-14T09:11:11.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f2db15f-0d9e-43c7-8c59-74349994fae8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112732024-11-14T09:11:11.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f2db15f-0d9e-43c7-8c59-74349994fae8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112742024-11-14T09:11:11.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3f2db15f-0d9e-43c7-8c59-74349994fae8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112752024-11-14T09:11:12.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d2f1d4b3-ea32-42f6-9c84-a8e04bd63b3a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112762024-11-14T09:11:12.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d2f1d4b3-ea32-42f6-9c84-a8e04bd63b3a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112772024-11-14T09:11:12.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d2f1d4b3-ea32-42f6-9c84-a8e04bd63b3a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112782024-11-14T09:11:13.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e4f07f97-4f42-4481-b6a5-0a2440b1a85a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112792024-11-14T09:11:13.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e4f07f97-4f42-4481-b6a5-0a2440b1a85a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112802024-11-14T09:11:13.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e4f07f97-4f42-4481-b6a5-0a2440b1a85a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112812024-11-14T09:11:14.053ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1431 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = abacc161-be2b-4866-951a-2f11e3c0ab0d response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
112822024-11-14T09:11:14.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af17e146-4f11-45b3-8b2e-25a9738549b6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112832024-11-14T09:11:14.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af17e146-4f11-45b3-8b2e-25a9738549b6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112842024-11-14T09:11:14.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af17e146-4f11-45b3-8b2e-25a9738549b6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112852024-11-14T09:11:15.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb0a7cab-f9b9-4c8a-9503-98718d6f9c9c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112862024-11-14T09:11:15.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb0a7cab-f9b9-4c8a-9503-98718d6f9c9c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112872024-11-14T09:11:15.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = cb0a7cab-f9b9-4c8a-9503-98718d6f9c9c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
112882024-11-14T09:11:15.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
112892024-11-14T09:11:15.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112902024-11-14T09:11:15.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
112912024-11-14T09:11:15.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112922024-11-14T09:11:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112932024-11-14T09:11:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112942024-11-14T09:11:15.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112952024-11-14T09:11:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112962024-11-14T09:11:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112972024-11-14T09:11:15.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112982024-11-14T09:11:15.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112992024-11-14T09:11:15.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113002024-11-14T09:11:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113012024-11-14T09:11:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113022024-11-14T09:11:15.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113032024-11-14T09:11:15.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
113042024-11-14T09:11:15.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113052024-11-14T09:11:15.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113062024-11-14T09:11:15.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
113072024-11-14T09:11:15.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.305995ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
113082024-11-14T09:11:15.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.9082ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113092024-11-14T09:11:16.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 035d90eb-eb04-4391-9ab4-1ad26d090b50 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113102024-11-14T09:11:16.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 035d90eb-eb04-4391-9ab4-1ad26d090b50 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113112024-11-14T09:11:16.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 035d90eb-eb04-4391-9ab4-1ad26d090b50 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113122024-11-14T09:11:17.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62ff0a99-aa63-4661-95e6-326ece501257 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113132024-11-14T09:11:17.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62ff0a99-aa63-4661-95e6-326ece501257 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113142024-11-14T09:11:17.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 62ff0a99-aa63-4661-95e6-326ece501257 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113152024-11-14T09:11:18.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65fa97b9-4357-40a6-9058-8f3c8467766c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113162024-11-14T09:11:18.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65fa97b9-4357-40a6-9058-8f3c8467766c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113172024-11-14T09:11:18.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 65fa97b9-4357-40a6-9058-8f3c8467766c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113182024-11-14T09:11:19.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e21a9fc4-72bf-461c-a479-5e152f68043c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113192024-11-14T09:11:19.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e21a9fc4-72bf-461c-a479-5e152f68043c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113202024-11-14T09:11:19.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e21a9fc4-72bf-461c-a479-5e152f68043c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113212024-11-14T09:11:20.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5fb3b78-645d-4f59-9def-51c025ac153f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113222024-11-14T09:11:20.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5fb3b78-645d-4f59-9def-51c025ac153f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113232024-11-14T09:11:20.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d5fb3b78-645d-4f59-9def-51c025ac153f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113242024-11-14T09:11:21.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 79519f86-10cc-43b5-84f9-3b373336f2aa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113252024-11-14T09:11:21.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 79519f86-10cc-43b5-84f9-3b373336f2aa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113262024-11-14T09:11:21.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 79519f86-10cc-43b5-84f9-3b373336f2aa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113272024-11-14T09:11:22.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c09986c-55f0-451c-836f-905ab8ef612f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113282024-11-14T09:11:22.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c09986c-55f0-451c-836f-905ab8ef612f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113292024-11-14T09:11:22.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c09986c-55f0-451c-836f-905ab8ef612f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113302024-11-14T09:11:23.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a928812f-89c0-4a32-9824-cac8d12185c1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113312024-11-14T09:11:23.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a928812f-89c0-4a32-9824-cac8d12185c1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113322024-11-14T09:11:23.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a928812f-89c0-4a32-9824-cac8d12185c1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113332024-11-14T09:11:24.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca989fdd-f63d-4d82-badf-f68359fe4195 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113342024-11-14T09:11:24.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca989fdd-f63d-4d82-badf-f68359fe4195 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113352024-11-14T09:11:24.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca989fdd-f63d-4d82-badf-f68359fe4195 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113362024-11-14T09:11:25.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6051a8d5-cbdb-4ae3-af57-c4a0aa031b68 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113372024-11-14T09:11:25.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6051a8d5-cbdb-4ae3-af57-c4a0aa031b68 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113382024-11-14T09:11:25.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6051a8d5-cbdb-4ae3-af57-c4a0aa031b68 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113392024-11-14T09:11:25.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
113402024-11-14T09:11:25.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
113412024-11-14T09:11:25.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113422024-11-14T09:11:25.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113432024-11-14T09:11:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113442024-11-14T09:11:25.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113452024-11-14T09:11:25.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113462024-11-14T09:11:25.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113472024-11-14T09:11:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113482024-11-14T09:11:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113492024-11-14T09:11:25.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113502024-11-14T09:11:25.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113512024-11-14T09:11:25.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113522024-11-14T09:11:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113532024-11-14T09:11:25.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113542024-11-14T09:11:25.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
113552024-11-14T09:11:25.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113562024-11-14T09:11:25.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113572024-11-14T09:11:25.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
113582024-11-14T09:11:25.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.460285ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
113592024-11-14T09:11:25.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.509363ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113602024-11-14T09:11:26.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f975803c-10c1-47e0-a7b3-2e1510fc431c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113612024-11-14T09:11:26.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f975803c-10c1-47e0-a7b3-2e1510fc431c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113622024-11-14T09:11:26.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f975803c-10c1-47e0-a7b3-2e1510fc431c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113632024-11-14T09:11:27.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fea6441c-c092-4338-b990-153008f64e32 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113642024-11-14T09:11:27.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fea6441c-c092-4338-b990-153008f64e32 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113652024-11-14T09:11:27.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fea6441c-c092-4338-b990-153008f64e32 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113662024-11-14T09:11:28.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = adcf17bf-a397-49e3-85c4-5cbc8ac8467a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
113672024-11-14T09:11:28.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = adcf17bf-a397-49e3-85c4-5cbc8ac8467a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
113682024-11-14T09:11:28.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = adcf17bf-a397-49e3-85c4-5cbc8ac8467a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
113692024-11-14T09:11:28.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 834b622c-23fa-4b0e-bbcc-19a177808892 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113702024-11-14T09:11:28.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 834b622c-23fa-4b0e-bbcc-19a177808892 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113712024-11-14T09:11:28.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 834b622c-23fa-4b0e-bbcc-19a177808892 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113722024-11-14T09:11:29.053ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 23447220-133f-4d2b-a897-73128da251d9 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
113732024-11-14T09:11:29.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 779f13d4-5b64-47bc-b05b-d48dcc875a5f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113742024-11-14T09:11:29.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 779f13d4-5b64-47bc-b05b-d48dcc875a5f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113752024-11-14T09:11:29.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 779f13d4-5b64-47bc-b05b-d48dcc875a5f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113762024-11-14T09:11:30.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7edea53-f221-400a-a6a4-e0b7a90bd6ba roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113772024-11-14T09:11:30.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7edea53-f221-400a-a6a4-e0b7a90bd6ba resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113782024-11-14T09:11:30.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d7edea53-f221-400a-a6a4-e0b7a90bd6ba response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113792024-11-14T09:11:31.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc5451cf-d291-4cbf-88a3-207a7b203cbe roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113802024-11-14T09:11:31.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc5451cf-d291-4cbf-88a3-207a7b203cbe resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113812024-11-14T09:11:31.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fc5451cf-d291-4cbf-88a3-207a7b203cbe response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113822024-11-14T09:11:32.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11dcdc6d-df45-43a7-b145-7772c61cfb25 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113832024-11-14T09:11:32.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11dcdc6d-df45-43a7-b145-7772c61cfb25 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113842024-11-14T09:11:32.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11dcdc6d-df45-43a7-b145-7772c61cfb25 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113852024-11-14T09:11:33.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6939754-f82e-480e-9be0-42e822640845 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113862024-11-14T09:11:33.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6939754-f82e-480e-9be0-42e822640845 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113872024-11-14T09:11:33.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c6939754-f82e-480e-9be0-42e822640845 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113882024-11-14T09:11:34.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8f71194c-0f05-4719-a448-e35824e710ef roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113892024-11-14T09:11:34.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8f71194c-0f05-4719-a448-e35824e710ef resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113902024-11-14T09:11:34.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8f71194c-0f05-4719-a448-e35824e710ef response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
113912024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
113922024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113932024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
113942024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
113952024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
113962024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
113972024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113982024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
113992024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114002024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114012024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
114022024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114032024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114042024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
114052024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114062024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
114072024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114082024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114092024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
114102024-11-14T09:11:35.535ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114112024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
114122024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114132024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114142024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
114152024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
114162024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
114172024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114182024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
114192024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
114202024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
114212024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
114222024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
114232024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114242024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
114252024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114262024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114272024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114282024-11-14T09:11:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114292024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114302024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114312024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114322024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114332024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
114342024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114352024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114362024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
114372024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114382024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114392024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
114402024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114412024-11-14T09:11:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114422024-11-14T09:11:35.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114432024-11-14T09:11:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114442024-11-14T09:11:35.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114452024-11-14T09:11:35.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114462024-11-14T09:11:35.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.157257ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
114472024-11-14T09:11:35.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114482024-11-14T09:11:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
114492024-11-14T09:11:35.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114502024-11-14T09:11:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114512024-11-14T09:11:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
114522024-11-14T09:11:35.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114532024-11-14T09:11:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
114542024-11-14T09:11:35.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114552024-11-14T09:11:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114562024-11-14T09:11:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114572024-11-14T09:11:35.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114582024-11-14T09:11:35.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114592024-11-14T09:11:35.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1903, tv_nsec: 329490966 } })
114602024-11-14T09:11:35.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
114612024-11-14T09:11:35.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114622024-11-14T09:11:35.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1903, tv_nsec: 330272588 } })
114632024-11-14T09:11:35.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
114642024-11-14T09:11:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114652024-11-14T09:11:35.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114662024-11-14T09:11:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114672024-11-14T09:11:35.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114682024-11-14T09:11:35.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114692024-11-14T09:11:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114702024-11-14T09:11:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114712024-11-14T09:11:35.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114722024-11-14T09:11:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114732024-11-14T09:11:35.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1903, tv_nsec: 339066569 } })
114742024-11-14T09:11:35.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114752024-11-14T09:11:35.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
114762024-11-14T09:11:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114772024-11-14T09:11:35.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114782024-11-14T09:11:35.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114792024-11-14T09:11:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114802024-11-14T09:11:35.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114812024-11-14T09:11:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114822024-11-14T09:11:35.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114832024-11-14T09:11:35.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114842024-11-14T09:11:35.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114852024-11-14T09:11:35.579ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114862024-11-14T09:11:35.579ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114872024-11-14T09:11:35.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114882024-11-14T09:11:35.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114892024-11-14T09:11:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114902024-11-14T09:11:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114912024-11-14T09:11:35.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.751665ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
114922024-11-14T09:11:35.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114932024-11-14T09:11:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114942024-11-14T09:11:35.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114952024-11-14T09:11:35.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114962024-11-14T09:11:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114972024-11-14T09:11:35.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114982024-11-14T09:11:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
114992024-11-14T09:11:35.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115002024-11-14T09:11:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115012024-11-14T09:11:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115022024-11-14T09:11:35.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.149525ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115032024-11-14T09:11:35.599ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.281223ms iteration = 28 status = 0
115042024-11-14T09:11:35.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115052024-11-14T09:11:35.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.204884ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115062024-11-14T09:11:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
115072024-11-14T09:11:35.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115082024-11-14T09:11:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115092024-11-14T09:11:35.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115102024-11-14T09:11:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115112024-11-14T09:11:35.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115122024-11-14T09:11:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115132024-11-14T09:11:35.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115142024-11-14T09:11:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115152024-11-14T09:11:35.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.971823ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
115162024-11-14T09:11:35.614ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
115172024-11-14T09:11:35.614ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.155412ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
115182024-11-14T09:11:35.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
115192024-11-14T09:11:35.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.221436ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
115202024-11-14T09:11:35.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
115212024-11-14T09:11:35.631ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115222024-11-14T09:11:35.631ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d00449a2-8ee6-4c79-a59b-5faf5e26cefb", "content-length": "26", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115232024-11-14T09:11:35.631ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115242024-11-14T09:11:35.633ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115252024-11-14T09:11:35.633ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115262024-11-14T09:11:35.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115272024-11-14T09:11:35.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115282024-11-14T09:11:35.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.009354ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
115292024-11-14T09:11:35.633ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115302024-11-14T09:11:35.636ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
115312024-11-14T09:11:35.636ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115322024-11-14T09:11:35.636ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa5e078-0d9a-4723-975c-de2009ff624e", "content-length": "26", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115332024-11-14T09:11:35.636ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115342024-11-14T09:11:35.639ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115352024-11-14T09:11:35.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
115362024-11-14T09:11:35.641ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115372024-11-14T09:11:35.641ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8567bc7-640a-4c7d-9c5b-234097437833", "content-length": "26", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115382024-11-14T09:11:35.641ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115392024-11-14T09:11:35.643ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
115402024-11-14T09:11:35.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115412024-11-14T09:11:35.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115422024-11-14T09:11:35.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115432024-11-14T09:11:35.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115442024-11-14T09:11:35.662ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115452024-11-14T09:11:35.662ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
115462024-11-14T09:11:35.662ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.286975ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
115472024-11-14T09:11:35.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 17b65c88-c9f1-4187-8547-ecc5b2da0884 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
115482024-11-14T09:11:35.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 17b65c88-c9f1-4187-8547-ecc5b2da0884 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
115492024-11-14T09:11:35.714ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.996296ms iteration = 32 status = {"physical_disks_added":0}
115502024-11-14T09:11:35.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115512024-11-14T09:11:35.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115522024-11-14T09:11:35.765ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115532024-11-14T09:11:35.765ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cda93e6a-ac93-4ba6-a96d-9abea72c7ff6", "content-length": "2", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115542024-11-14T09:11:35.767ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115552024-11-14T09:11:35.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115562024-11-14T09:11:35.830ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.674314ms iteration = 28 status = {}
115572024-11-14T09:11:35.839ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
115582024-11-14T09:11:35.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115592024-11-14T09:11:35.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 17b65c88-c9f1-4187-8547-ecc5b2da0884 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
115602024-11-14T09:11:35.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115612024-11-14T09:11:35.842ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.427009ms iteration = 28 status = null
115622024-11-14T09:11:35.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115632024-11-14T09:11:35.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115642024-11-14T09:11:35.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115652024-11-14T09:11:35.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115662024-11-14T09:11:35.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115672024-11-14T09:11:35.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115682024-11-14T09:11:35.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115692024-11-14T09:11:35.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 333.579559ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
115702024-11-14T09:11:35.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83904efa-a005-4248-860f-fc12b9a76e18", "content-length": "372", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115712024-11-14T09:11:35.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115722024-11-14T09:11:35.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115732024-11-14T09:11:35.892ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
115742024-11-14T09:11:35.892ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115752024-11-14T09:11:35.892ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "320404f4-60e0-4e95-8636-4847c3a2cbea", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115762024-11-14T09:11:35.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115772024-11-14T09:11:35.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115782024-11-14T09:11:35.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115792024-11-14T09:11:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115802024-11-14T09:11:35.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115812024-11-14T09:11:35.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115822024-11-14T09:11:35.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115832024-11-14T09:11:35.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115842024-11-14T09:11:35.898ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
115852024-11-14T09:11:35.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115862024-11-14T09:11:35.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115872024-11-14T09:11:35.903ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115882024-11-14T09:11:35.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ef581c-9106-4962-8a58-2e16f1a53367", "content-length": "691", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115892024-11-14T09:11:35.903ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
115902024-11-14T09:11:35.903ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
115912024-11-14T09:11:35.903ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115922024-11-14T09:11:35.905ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 369.74178ms iteration = 29 status = {}
115932024-11-14T09:11:35.906ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115942024-11-14T09:11:35.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115952024-11-14T09:11:35.906ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8bef6d18-a4e6-4cb7-ab1c-c8aa35bf2b05", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115962024-11-14T09:11:35.907ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.296841ms iteration = 30 status = {}
115972024-11-14T09:11:35.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115982024-11-14T09:11:35.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "54d7378c-9220-445d-9921-784bfb528aec", "content-length": "134", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
115992024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
116002024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
116012024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116022024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116032024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116042024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116052024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116062024-11-14T09:11:35.912ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116072024-11-14T09:11:35.913ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116082024-11-14T09:11:35.913ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116092024-11-14T09:11:35.913ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
116102024-11-14T09:11:35.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116112024-11-14T09:11:35.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116122024-11-14T09:11:35.914ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
116132024-11-14T09:11:35.914ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2263002e-dfac-47c7-98a6-8afa439ff1a7", "content-length": "2", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
116142024-11-14T09:11:35.914ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
116152024-11-14T09:11:35.914ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c847a15b-2f88-40d0-a554-931d83a309bf", "content-length": "52", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
116162024-11-14T09:11:35.914ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
116172024-11-14T09:11:35.914ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116182024-11-14T09:11:36.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ae34ba5c-012c-41f9-8375-05797749dee6", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
116192024-11-14T09:11:36.018ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
116202024-11-14T09:11:36.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116212024-11-14T09:11:36.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "207c203b-05ff-4522-a26c-8f910d140b02", "content-length": "682", "date": "Thu, 14 Nov 2024 09:11:35 GMT"} })
116222024-11-14T09:11:36.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116232024-11-14T09:11:36.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116242024-11-14T09:11:36.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116252024-11-14T09:11:36.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116262024-11-14T09:11:36.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116272024-11-14T09:11:36.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116282024-11-14T09:11:36.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116292024-11-14T09:11:36.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116302024-11-14T09:11:36.036ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.060911ms iteration = 28 status = {}
116312024-11-14T09:11:36.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 492a6260-4ec2-4af1-9e4e-61690ac9bd6e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116322024-11-14T09:11:36.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 492a6260-4ec2-4af1-9e4e-61690ac9bd6e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116332024-11-14T09:11:36.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 492a6260-4ec2-4af1-9e4e-61690ac9bd6e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116342024-11-14T09:11:37.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af733a76-d384-4de6-af89-9d3d8d48425c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116352024-11-14T09:11:37.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af733a76-d384-4de6-af89-9d3d8d48425c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116362024-11-14T09:11:37.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af733a76-d384-4de6-af89-9d3d8d48425c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116372024-11-14T09:11:38.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 01e9bd72-a289-4863-bca6-5cc4582e7336 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116382024-11-14T09:11:38.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 01e9bd72-a289-4863-bca6-5cc4582e7336 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116392024-11-14T09:11:38.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 01e9bd72-a289-4863-bca6-5cc4582e7336 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116402024-11-14T09:11:39.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 49988aa8-90f8-425f-a5da-29e9c90bbfed roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116412024-11-14T09:11:39.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 49988aa8-90f8-425f-a5da-29e9c90bbfed resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116422024-11-14T09:11:39.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 49988aa8-90f8-425f-a5da-29e9c90bbfed response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116432024-11-14T09:11:40.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f1543704-1104-47af-acbc-33a598ff5414 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116442024-11-14T09:11:40.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f1543704-1104-47af-acbc-33a598ff5414 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116452024-11-14T09:11:40.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f1543704-1104-47af-acbc-33a598ff5414 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116462024-11-14T09:11:42.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b556307c-26f6-4741-a5ac-33c926e29e10 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116472024-11-14T09:11:42.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b556307c-26f6-4741-a5ac-33c926e29e10 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116482024-11-14T09:11:42.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b556307c-26f6-4741-a5ac-33c926e29e10 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116492024-11-14T09:11:43.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 57146798-944b-46b5-af2d-090422ee9813 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116502024-11-14T09:11:43.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 57146798-944b-46b5-af2d-090422ee9813 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116512024-11-14T09:11:43.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 57146798-944b-46b5-af2d-090422ee9813 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116522024-11-14T09:11:44.051ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 73548d67-1945-43a7-b912-a250fa534634 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
116532024-11-14T09:11:44.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28dd60cc-1357-42c8-8b62-4bc2d94f22e7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116542024-11-14T09:11:44.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28dd60cc-1357-42c8-8b62-4bc2d94f22e7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116552024-11-14T09:11:44.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 28dd60cc-1357-42c8-8b62-4bc2d94f22e7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116562024-11-14T09:11:45.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1f45e0b3-1f8c-4e7e-9e02-359f35d4d458 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116572024-11-14T09:11:45.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1f45e0b3-1f8c-4e7e-9e02-359f35d4d458 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116582024-11-14T09:11:45.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1f45e0b3-1f8c-4e7e-9e02-359f35d4d458 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116592024-11-14T09:11:45.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
116602024-11-14T09:11:45.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116612024-11-14T09:11:45.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
116622024-11-14T09:11:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116632024-11-14T09:11:45.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116642024-11-14T09:11:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116652024-11-14T09:11:45.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116662024-11-14T09:11:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116672024-11-14T09:11:45.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116682024-11-14T09:11:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116692024-11-14T09:11:45.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116702024-11-14T09:11:45.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116712024-11-14T09:11:45.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116722024-11-14T09:11:45.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
116732024-11-14T09:11:45.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116742024-11-14T09:11:45.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116752024-11-14T09:11:45.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
116762024-11-14T09:11:45.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.299482ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
116772024-11-14T09:11:45.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116782024-11-14T09:11:45.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116792024-11-14T09:11:45.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.160241ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116802024-11-14T09:11:46.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5dc4e4a-41bb-4284-9efc-c7fe5dc13ec4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116812024-11-14T09:11:46.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5dc4e4a-41bb-4284-9efc-c7fe5dc13ec4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116822024-11-14T09:11:46.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5dc4e4a-41bb-4284-9efc-c7fe5dc13ec4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116832024-11-14T09:11:47.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 25655158-07aa-4a1e-9dcc-857b0909ee2b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116842024-11-14T09:11:47.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 25655158-07aa-4a1e-9dcc-857b0909ee2b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116852024-11-14T09:11:47.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 25655158-07aa-4a1e-9dcc-857b0909ee2b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116862024-11-14T09:11:48.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 872d38e8-1379-42e6-b3ee-b5202c79ebb1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116872024-11-14T09:11:48.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 872d38e8-1379-42e6-b3ee-b5202c79ebb1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116882024-11-14T09:11:48.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 872d38e8-1379-42e6-b3ee-b5202c79ebb1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116892024-11-14T09:11:49.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baf139e0-07ca-4536-b7bf-7d6b84408ce7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116902024-11-14T09:11:49.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baf139e0-07ca-4536-b7bf-7d6b84408ce7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116912024-11-14T09:11:49.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = baf139e0-07ca-4536-b7bf-7d6b84408ce7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116922024-11-14T09:11:50.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ff9a3f9-55bc-4cd0-85f7-82b375d82998 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116932024-11-14T09:11:50.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ff9a3f9-55bc-4cd0-85f7-82b375d82998 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116942024-11-14T09:11:50.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ff9a3f9-55bc-4cd0-85f7-82b375d82998 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116952024-11-14T09:11:51.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f77ab4a-761c-4fb8-8f74-f0f5018d3bed roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116962024-11-14T09:11:51.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f77ab4a-761c-4fb8-8f74-f0f5018d3bed resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116972024-11-14T09:11:51.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2f77ab4a-761c-4fb8-8f74-f0f5018d3bed response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116982024-11-14T09:11:52.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44e53080-e371-44da-b784-f85d7ebf9e99 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
116992024-11-14T09:11:52.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44e53080-e371-44da-b784-f85d7ebf9e99 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117002024-11-14T09:11:52.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 44e53080-e371-44da-b784-f85d7ebf9e99 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117012024-11-14T09:11:53.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4d29ebd0-269a-43c2-a035-ba6b311dca94 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117022024-11-14T09:11:53.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4d29ebd0-269a-43c2-a035-ba6b311dca94 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117032024-11-14T09:11:53.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4d29ebd0-269a-43c2-a035-ba6b311dca94 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117042024-11-14T09:11:54.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b786257a-2f42-49ab-8e23-d35ad702a807 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117052024-11-14T09:11:54.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b786257a-2f42-49ab-8e23-d35ad702a807 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117062024-11-14T09:11:54.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b786257a-2f42-49ab-8e23-d35ad702a807 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117072024-11-14T09:11:55.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 897fa55e-5d5e-491d-ac07-909012f49922 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117082024-11-14T09:11:55.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 897fa55e-5d5e-491d-ac07-909012f49922 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117092024-11-14T09:11:55.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 897fa55e-5d5e-491d-ac07-909012f49922 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117102024-11-14T09:11:55.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
117112024-11-14T09:11:55.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
117122024-11-14T09:11:55.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117132024-11-14T09:11:55.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117142024-11-14T09:11:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117152024-11-14T09:11:55.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117162024-11-14T09:11:55.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117172024-11-14T09:11:55.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117182024-11-14T09:11:55.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117192024-11-14T09:11:55.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.38283ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117202024-11-14T09:11:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117212024-11-14T09:11:55.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117222024-11-14T09:11:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117232024-11-14T09:11:55.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117242024-11-14T09:11:55.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117252024-11-14T09:11:55.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117262024-11-14T09:11:55.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
117272024-11-14T09:11:55.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117282024-11-14T09:11:55.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117292024-11-14T09:11:55.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
117302024-11-14T09:11:55.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.427096ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
117312024-11-14T09:11:56.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be2d5ee4-f2ff-41de-b882-b7d8f2f2f758 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117322024-11-14T09:11:56.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be2d5ee4-f2ff-41de-b882-b7d8f2f2f758 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117332024-11-14T09:11:56.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = be2d5ee4-f2ff-41de-b882-b7d8f2f2f758 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117342024-11-14T09:11:57.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1085b710-ddf8-4c8c-84b5-3c8b3798f17b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117352024-11-14T09:11:57.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1085b710-ddf8-4c8c-84b5-3c8b3798f17b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117362024-11-14T09:11:57.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1085b710-ddf8-4c8c-84b5-3c8b3798f17b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117372024-11-14T09:11:58.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f592d6a9-bafd-4fe6-9ae8-c07b873fd9cf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
117382024-11-14T09:11:58.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f592d6a9-bafd-4fe6-9ae8-c07b873fd9cf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
117392024-11-14T09:11:58.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = f592d6a9-bafd-4fe6-9ae8-c07b873fd9cf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
117402024-11-14T09:11:58.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3d7c138-c35b-4ee1-b6d3-2447adb74c3d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117412024-11-14T09:11:58.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3d7c138-c35b-4ee1-b6d3-2447adb74c3d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117422024-11-14T09:11:58.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3d7c138-c35b-4ee1-b6d3-2447adb74c3d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117432024-11-14T09:11:59.053ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1661 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = f691c035-6ac4-4153-9a9a-38c022b30124 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
117442024-11-14T09:11:59.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4061fba-1a13-47a3-bf06-c7a7c4d6e3bb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117452024-11-14T09:11:59.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4061fba-1a13-47a3-bf06-c7a7c4d6e3bb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117462024-11-14T09:11:59.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c4061fba-1a13-47a3-bf06-c7a7c4d6e3bb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117472024-11-14T09:12:00.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5dc22ea0-8e25-4a25-aa71-db04c9472866 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117482024-11-14T09:12:00.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5dc22ea0-8e25-4a25-aa71-db04c9472866 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117492024-11-14T09:12:00.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5dc22ea0-8e25-4a25-aa71-db04c9472866 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117502024-11-14T09:12:01.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 14cd5dd5-2e2d-4eb7-8380-9896e576a19f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117512024-11-14T09:12:01.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 14cd5dd5-2e2d-4eb7-8380-9896e576a19f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117522024-11-14T09:12:01.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 14cd5dd5-2e2d-4eb7-8380-9896e576a19f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117532024-11-14T09:12:02.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 16623778-9bfc-40bc-9fc4-ba069f25d4da roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117542024-11-14T09:12:02.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 16623778-9bfc-40bc-9fc4-ba069f25d4da resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117552024-11-14T09:12:02.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 16623778-9bfc-40bc-9fc4-ba069f25d4da response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117562024-11-14T09:12:03.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f6997c06-9ce2-41b5-a96c-18130e25d0e4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117572024-11-14T09:12:03.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f6997c06-9ce2-41b5-a96c-18130e25d0e4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117582024-11-14T09:12:03.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f6997c06-9ce2-41b5-a96c-18130e25d0e4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117592024-11-14T09:12:04.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c3ff6f13-f54c-4ed6-9c9d-f6361d3924f8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117602024-11-14T09:12:04.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c3ff6f13-f54c-4ed6-9c9d-f6361d3924f8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117612024-11-14T09:12:04.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c3ff6f13-f54c-4ed6-9c9d-f6361d3924f8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
117622024-11-14T09:12:05.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
117632024-11-14T09:12:05.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117642024-11-14T09:12:05.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
117652024-11-14T09:12:05.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
117662024-11-14T09:12:05.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
117672024-11-14T09:12:05.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
117682024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117692024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
117702024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
117712024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117722024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
117732024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
117742024-11-14T09:12:05.535ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
117752024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117762024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
117772024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.511\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
117782024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
117792024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
117802024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117812024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117822024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
117832024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117842024-11-14T09:12:05.535ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
117852024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
117862024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
117872024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
117882024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117892024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
117902024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
117912024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117922024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
117932024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
117942024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117952024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117962024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
117972024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
117982024-11-14T09:12:05.535ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 09:02:05.535121871 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
117992024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
118002024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
118012024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
118022024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
118032024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118042024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
118052024-11-14T09:12:05.535ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
118062024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118072024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
118082024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
118092024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118102024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
118112024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
118122024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118132024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118142024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118152024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118162024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118172024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118182024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118192024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118202024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118212024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118222024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118232024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
118242024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
118252024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
118262024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
118272024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
118282024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
118292024-11-14T09:12:05.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1933, tv_nsec: 318512170 } })
118302024-11-14T09:12:05.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1933, tv_nsec: 318505059 } })
118312024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
118322024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118332024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118342024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118352024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118362024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
118372024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
118382024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
118392024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
118402024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118412024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
118422024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118432024-11-14T09:12:05.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118442024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
118452024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
118462024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
118472024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
118482024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118492024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118502024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
118512024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.454603ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
118522024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
118532024-11-14T09:12:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.359672ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
118542024-11-14T09:12:05.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118552024-11-14T09:12:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118562024-11-14T09:12:05.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118572024-11-14T09:12:05.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.404131ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
118582024-11-14T09:12:05.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118592024-11-14T09:12:05.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1933, tv_nsec: 323383038 } })
118602024-11-14T09:12:05.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
118612024-11-14T09:12:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118622024-11-14T09:12:05.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118632024-11-14T09:12:05.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118642024-11-14T09:12:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118652024-11-14T09:12:05.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118662024-11-14T09:12:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118672024-11-14T09:12:05.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118682024-11-14T09:12:05.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118692024-11-14T09:12:05.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118702024-11-14T09:12:05.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118712024-11-14T09:12:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118722024-11-14T09:12:05.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118732024-11-14T09:12:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118742024-11-14T09:12:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118752024-11-14T09:12:05.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118762024-11-14T09:12:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118772024-11-14T09:12:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118782024-11-14T09:12:05.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118792024-11-14T09:12:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118802024-11-14T09:12:05.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118812024-11-14T09:12:05.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118822024-11-14T09:12:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118832024-11-14T09:12:05.551ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118842024-11-14T09:12:05.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118852024-11-14T09:12:05.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118862024-11-14T09:12:05.552ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 09:02:05.535121871 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
118872024-11-14T09:12:05.552ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.150335ms iteration = 15 status = {"expiration":"2024-11-14T09:02:05.535121871Z","pruned":[]}
118882024-11-14T09:12:05.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118892024-11-14T09:12:05.554ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118902024-11-14T09:12:05.554ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118912024-11-14T09:12:05.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118922024-11-14T09:12:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
118932024-11-14T09:12:05.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
118942024-11-14T09:12:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118952024-11-14T09:12:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
118962024-11-14T09:12:05.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118972024-11-14T09:12:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118982024-11-14T09:12:05.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118992024-11-14T09:12:05.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119002024-11-14T09:12:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119012024-11-14T09:12:05.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119022024-11-14T09:12:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119032024-11-14T09:12:05.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1933, tv_nsec: 339759961 } })
119042024-11-14T09:12:05.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.591327ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
119052024-11-14T09:12:05.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
119062024-11-14T09:12:05.559ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.64055ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
119072024-11-14T09:12:05.559ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
119082024-11-14T09:12:05.559ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
119092024-11-14T09:12:05.559ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.037576ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
119102024-11-14T09:12:05.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119112024-11-14T09:12:05.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119122024-11-14T09:12:05.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119132024-11-14T09:12:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119142024-11-14T09:12:05.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119152024-11-14T09:12:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119162024-11-14T09:12:05.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119172024-11-14T09:12:05.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1933, tv_nsec: 345684106 } })
119182024-11-14T09:12:05.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119192024-11-14T09:12:05.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
119202024-11-14T09:12:05.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119212024-11-14T09:12:05.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119222024-11-14T09:12:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119232024-11-14T09:12:05.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119242024-11-14T09:12:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119252024-11-14T09:12:05.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119262024-11-14T09:12:05.566ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119272024-11-14T09:12:05.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119282024-11-14T09:12:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119292024-11-14T09:12:05.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119302024-11-14T09:12:05.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119312024-11-14T09:12:05.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119322024-11-14T09:12:05.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119332024-11-14T09:12:05.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119342024-11-14T09:12:05.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119352024-11-14T09:12:05.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 37.659885ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
119362024-11-14T09:12:05.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119372024-11-14T09:12:05.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119382024-11-14T09:12:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119392024-11-14T09:12:05.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119402024-11-14T09:12:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119412024-11-14T09:12:05.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
119422024-11-14T09:12:05.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119432024-11-14T09:12:05.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119442024-11-14T09:12:05.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5d869ac-af8e-411f-a47a-9bcfdb8e1594 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
119452024-11-14T09:12:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
119462024-11-14T09:12:05.579ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119472024-11-14T09:12:05.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5d869ac-af8e-411f-a47a-9bcfdb8e1594 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
119482024-11-14T09:12:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119492024-11-14T09:12:05.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f5d869ac-af8e-411f-a47a-9bcfdb8e1594 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
119502024-11-14T09:12:05.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.726531ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119512024-11-14T09:12:05.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.663632ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
119522024-11-14T09:12:05.610ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
119532024-11-14T09:12:05.610ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.33772ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
119542024-11-14T09:12:05.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.642499ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119552024-11-14T09:12:05.618ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
119562024-11-14T09:12:05.618ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
119572024-11-14T09:12:05.618ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.727105ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
119582024-11-14T09:12:05.620ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119592024-11-14T09:12:05.620ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
119602024-11-14T09:12:05.620ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119612024-11-14T09:12:05.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119622024-11-14T09:12:05.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119632024-11-14T09:12:05.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119642024-11-14T09:12:05.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119652024-11-14T09:12:05.624ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
119662024-11-14T09:12:05.624ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.196963ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
119672024-11-14T09:12:05.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119682024-11-14T09:12:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119692024-11-14T09:12:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119702024-11-14T09:12:05.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
119712024-11-14T09:12:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
119722024-11-14T09:12:05.628ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
119732024-11-14T09:12:05.628ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
119742024-11-14T09:12:05.628ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
119752024-11-14T09:12:05.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119762024-11-14T09:12:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119772024-11-14T09:12:05.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119782024-11-14T09:12:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119792024-11-14T09:12:05.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119802024-11-14T09:12:05.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119812024-11-14T09:12:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119822024-11-14T09:12:05.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119832024-11-14T09:12:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119842024-11-14T09:12:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
119852024-11-14T09:12:05.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119862024-11-14T09:12:05.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.187444ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
119872024-11-14T09:12:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119882024-11-14T09:12:05.637ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.11252ms iteration = 29 status = 0
119892024-11-14T09:12:05.637ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
119902024-11-14T09:12:05.637ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
119912024-11-14T09:12:05.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119922024-11-14T09:12:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119932024-11-14T09:12:05.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119942024-11-14T09:12:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119952024-11-14T09:12:05.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119962024-11-14T09:12:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119972024-11-14T09:12:05.646ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
119982024-11-14T09:12:05.646ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
119992024-11-14T09:12:05.646ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
120002024-11-14T09:12:05.646ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 111.018234ms iteration = 16 status = {"generation":2}
120012024-11-14T09:12:05.661ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120022024-11-14T09:12:05.661ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
120032024-11-14T09:12:05.661ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.078235ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
120042024-11-14T09:12:05.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
120052024-11-14T09:12:05.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120062024-11-14T09:12:05.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
120072024-11-14T09:12:05.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
120082024-11-14T09:12:05.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
120092024-11-14T09:12:05.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120102024-11-14T09:12:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120112024-11-14T09:12:05.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
120122024-11-14T09:12:05.674ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120132024-11-14T09:12:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120142024-11-14T09:12:05.710ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
120152024-11-14T09:12:05.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 175.314666ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
120162024-11-14T09:12:05.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120172024-11-14T09:12:05.716ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
120182024-11-14T09:12:05.716ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120192024-11-14T09:12:05.717ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7d33190-3e63-409d-b876-254bf74c7198", "content-length": "26", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120202024-11-14T09:12:05.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120212024-11-14T09:12:05.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120222024-11-14T09:12:05.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120232024-11-14T09:12:05.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120242024-11-14T09:12:05.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120252024-11-14T09:12:05.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120262024-11-14T09:12:05.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
120272024-11-14T09:12:05.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
120282024-11-14T09:12:05.725ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120292024-11-14T09:12:05.725ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de5d2639-edb6-48c2-bc4d-4449d9a0da75", "content-length": "26", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120302024-11-14T09:12:05.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120312024-11-14T09:12:05.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120322024-11-14T09:12:05.741ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.250894ms iteration = 33 status = {"physical_disks_added":0}
120332024-11-14T09:12:05.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
120342024-11-14T09:12:05.822ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120352024-11-14T09:12:05.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120362024-11-14T09:12:05.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1976ab37-fe14-4ef3-81c3-f7ad473df55e", "content-length": "372", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120372024-11-14T09:12:05.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120382024-11-14T09:12:05.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120392024-11-14T09:12:05.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
120402024-11-14T09:12:05.824ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120412024-11-14T09:12:05.824ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e37adfe-cf75-42b7-948d-3846a733897f", "content-length": "26", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120422024-11-14T09:12:05.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120432024-11-14T09:12:05.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120442024-11-14T09:12:05.827ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120452024-11-14T09:12:05.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120462024-11-14T09:12:05.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120472024-11-14T09:12:05.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120482024-11-14T09:12:05.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120492024-11-14T09:12:05.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120502024-11-14T09:12:05.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120512024-11-14T09:12:05.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120522024-11-14T09:12:05.836ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
120532024-11-14T09:12:05.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "edcb47ec-8a84-4969-bff2-6939df560949", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120542024-11-14T09:12:05.836ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120552024-11-14T09:12:05.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "75c1f58b-a7ce-4fe7-a0f6-b5ca025e12de", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120562024-11-14T09:12:05.839ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120572024-11-14T09:12:05.840ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120582024-11-14T09:12:05.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 305.683152ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
120592024-11-14T09:12:05.855ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
120602024-11-14T09:12:05.855ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
120612024-11-14T09:12:05.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120622024-11-14T09:12:05.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120632024-11-14T09:12:05.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120642024-11-14T09:12:05.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120652024-11-14T09:12:05.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120662024-11-14T09:12:05.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120672024-11-14T09:12:05.862ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
120682024-11-14T09:12:05.862ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 327.810947ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
120692024-11-14T09:12:05.863ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
120702024-11-14T09:12:05.863ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
120712024-11-14T09:12:05.863ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
120722024-11-14T09:12:05.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 328.00265ms iteration = 16 status = {"generation":1}
120732024-11-14T09:12:05.870ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
120742024-11-14T09:12:05.870ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120752024-11-14T09:12:05.881ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 346.6588ms iteration = 29 status = {}
120762024-11-14T09:12:05.957ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "591a2867-cb53-4319-baf9-301fa95fd509", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120772024-11-14T09:12:05.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120782024-11-14T09:12:05.957ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
120792024-11-14T09:12:05.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120802024-11-14T09:12:05.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120812024-11-14T09:12:05.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120822024-11-14T09:12:05.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120832024-11-14T09:12:05.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120842024-11-14T09:12:06.086ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
120852024-11-14T09:12:06.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f425a1d0-bf0c-446e-bcd9-b6a273bb526b", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
120862024-11-14T09:12:06.087ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
120872024-11-14T09:12:06.088ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5e31f587-6437-4d8b-b000-e89d836374ca", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
120882024-11-14T09:12:06.088ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
120892024-11-14T09:12:06.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
120902024-11-14T09:12:06.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa4764ec-4f28-499d-9dae-f90e9219a81b", "content-length": "691", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120912024-11-14T09:12:06.090ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
120922024-11-14T09:12:06.090ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
120932024-11-14T09:12:06.090ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
120942024-11-14T09:12:06.090ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120952024-11-14T09:12:06.090ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dada8c6-cc2a-4317-a507-d83706287843", "content-length": "2", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
120962024-11-14T09:12:06.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dc3a1618-8ba6-4a35-9fea-0ba8c966387f", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
120972024-11-14T09:12:06.091ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
120982024-11-14T09:12:06.093ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
120992024-11-14T09:12:06.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
121002024-11-14T09:12:06.093ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e170a4ec-fb25-4ea6-850a-530810f04fa6", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
121012024-11-14T09:12:06.098ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 563.688296ms iteration = 30 status = {}
121022024-11-14T09:12:06.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121032024-11-14T09:12:06.100ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
121042024-11-14T09:12:06.100ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 565.249331ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
121052024-11-14T09:12:06.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121062024-11-14T09:12:06.100ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 565.543806ms iteration = 31 status = {}
121072024-11-14T09:12:06.101ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 566.952278ms iteration = 29 status = null
121082024-11-14T09:12:06.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121092024-11-14T09:12:06.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121102024-11-14T09:12:06.106ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
121112024-11-14T09:12:06.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121122024-11-14T09:12:06.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121132024-11-14T09:12:06.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
121142024-11-14T09:12:06.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "984c444d-4949-4de2-96b7-e5158b93f5f2", "content-length": "134", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
121152024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
121162024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
121172024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
121182024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
121192024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121202024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121212024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121222024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121232024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121242024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121252024-11-14T09:12:06.116ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
121262024-11-14T09:12:06.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121272024-11-14T09:12:06.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121282024-11-14T09:12:06.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
121292024-11-14T09:12:06.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "010ec49d-0805-4825-8886-85674148ae71", "content-length": "2", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
121302024-11-14T09:12:06.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
121312024-11-14T09:12:06.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "707d2727-c0f6-4970-8798-72cc62efbf09", "content-length": "52", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
121322024-11-14T09:12:06.119ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
121332024-11-14T09:12:06.119ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
121342024-11-14T09:12:06.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1c7bdf36-57cc-407b-880b-4b40fb201c3e", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
121352024-11-14T09:12:06.224ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
121362024-11-14T09:12:06.224ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121372024-11-14T09:12:06.225ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f868c46c-24d0-400c-b373-9fec0e96552c", "content-length": "682", "date": "Thu, 14 Nov 2024 09:12:05 GMT"} })
121382024-11-14T09:12:06.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121392024-11-14T09:12:06.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121402024-11-14T09:12:06.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121412024-11-14T09:12:06.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121422024-11-14T09:12:06.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121432024-11-14T09:12:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121442024-11-14T09:12:06.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121452024-11-14T09:12:06.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121462024-11-14T09:12:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 707.145511ms iteration = 29 status = {}
121472024-11-14T09:12:06.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d9509e1e-c185-460f-92c3-ad3db86678d2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121482024-11-14T09:12:06.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d9509e1e-c185-460f-92c3-ad3db86678d2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121492024-11-14T09:12:06.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d9509e1e-c185-460f-92c3-ad3db86678d2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121502024-11-14T09:12:07.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = da3942b0-5236-4c98-9aa0-b75a33171023 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121512024-11-14T09:12:07.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = da3942b0-5236-4c98-9aa0-b75a33171023 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121522024-11-14T09:12:07.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = da3942b0-5236-4c98-9aa0-b75a33171023 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121532024-11-14T09:12:08.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d43d4ba8-e190-4a9c-a077-8d4ad360d95d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121542024-11-14T09:12:08.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d43d4ba8-e190-4a9c-a077-8d4ad360d95d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121552024-11-14T09:12:08.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d43d4ba8-e190-4a9c-a077-8d4ad360d95d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121562024-11-14T09:12:09.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8377f47-326a-4e49-85fb-6307b2e84e5e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121572024-11-14T09:12:09.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8377f47-326a-4e49-85fb-6307b2e84e5e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121582024-11-14T09:12:09.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8377f47-326a-4e49-85fb-6307b2e84e5e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121592024-11-14T09:12:10.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73fbaa54-daa2-4a71-8ce4-493687e893fa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121602024-11-14T09:12:10.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73fbaa54-daa2-4a71-8ce4-493687e893fa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121612024-11-14T09:12:10.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73fbaa54-daa2-4a71-8ce4-493687e893fa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121622024-11-14T09:12:11.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c4771fc-867a-4b23-bc9a-abdefbd18663 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121632024-11-14T09:12:11.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c4771fc-867a-4b23-bc9a-abdefbd18663 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121642024-11-14T09:12:11.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6c4771fc-867a-4b23-bc9a-abdefbd18663 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121652024-11-14T09:12:12.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a4641c2-b0b3-40ec-8062-43f707b16a58 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121662024-11-14T09:12:12.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a4641c2-b0b3-40ec-8062-43f707b16a58 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121672024-11-14T09:12:12.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1a4641c2-b0b3-40ec-8062-43f707b16a58 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121682024-11-14T09:12:13.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa027544-946c-4167-89c4-8031efe63ae5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121692024-11-14T09:12:13.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa027544-946c-4167-89c4-8031efe63ae5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121702024-11-14T09:12:13.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa027544-946c-4167-89c4-8031efe63ae5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121712024-11-14T09:12:14.052ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = eca9f568-495c-4d63-a3a5-796b7f2c3bf1 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
121722024-11-14T09:12:14.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73b67782-1d86-4617-8d4c-88c9318f3235 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121732024-11-14T09:12:14.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73b67782-1d86-4617-8d4c-88c9318f3235 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121742024-11-14T09:12:14.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 73b67782-1d86-4617-8d4c-88c9318f3235 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121752024-11-14T09:12:15.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
121762024-11-14T09:12:15.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
121772024-11-14T09:12:15.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121782024-11-14T09:12:15.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121792024-11-14T09:12:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121802024-11-14T09:12:15.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121812024-11-14T09:12:15.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121822024-11-14T09:12:15.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121832024-11-14T09:12:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121842024-11-14T09:12:15.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.747956ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121852024-11-14T09:12:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121862024-11-14T09:12:15.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121872024-11-14T09:12:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121882024-11-14T09:12:15.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121892024-11-14T09:12:15.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121902024-11-14T09:12:15.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121912024-11-14T09:12:15.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
121922024-11-14T09:12:15.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121932024-11-14T09:12:15.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121942024-11-14T09:12:15.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
121952024-11-14T09:12:15.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.079903ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
121962024-11-14T09:12:15.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ee064fa-37cb-438b-ba18-4dab9b2a431f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121972024-11-14T09:12:15.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ee064fa-37cb-438b-ba18-4dab9b2a431f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121982024-11-14T09:12:15.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9ee064fa-37cb-438b-ba18-4dab9b2a431f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
121992024-11-14T09:12:16.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 554e550d-0f1c-4090-bbb0-8247171034aa roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122002024-11-14T09:12:16.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 554e550d-0f1c-4090-bbb0-8247171034aa resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122012024-11-14T09:12:16.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 554e550d-0f1c-4090-bbb0-8247171034aa response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122022024-11-14T09:12:17.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83f776df-fa86-4066-a4ed-9ee13572d8f0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122032024-11-14T09:12:17.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83f776df-fa86-4066-a4ed-9ee13572d8f0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122042024-11-14T09:12:17.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83f776df-fa86-4066-a4ed-9ee13572d8f0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122052024-11-14T09:12:18.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 27402bea-dc82-430b-8789-11236080ab5c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122062024-11-14T09:12:18.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 27402bea-dc82-430b-8789-11236080ab5c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122072024-11-14T09:12:18.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 27402bea-dc82-430b-8789-11236080ab5c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122082024-11-14T09:12:19.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 36b7a048-cb54-4ea8-9d64-bb0ff5572ca4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122092024-11-14T09:12:19.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 36b7a048-cb54-4ea8-9d64-bb0ff5572ca4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122102024-11-14T09:12:19.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 36b7a048-cb54-4ea8-9d64-bb0ff5572ca4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122112024-11-14T09:12:20.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 142bff98-897c-4852-9bfb-39ad9181b661 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122122024-11-14T09:12:20.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 142bff98-897c-4852-9bfb-39ad9181b661 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122132024-11-14T09:12:20.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 142bff98-897c-4852-9bfb-39ad9181b661 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122142024-11-14T09:12:21.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd9bc4e1-378f-4259-85d7-8f5b2818fa87 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122152024-11-14T09:12:21.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd9bc4e1-378f-4259-85d7-8f5b2818fa87 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122162024-11-14T09:12:21.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd9bc4e1-378f-4259-85d7-8f5b2818fa87 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122172024-11-14T09:12:23.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21885d6f-15fe-4845-8ff6-609ef12642fd roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122182024-11-14T09:12:23.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21885d6f-15fe-4845-8ff6-609ef12642fd resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122192024-11-14T09:12:23.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 21885d6f-15fe-4845-8ff6-609ef12642fd response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122202024-11-14T09:12:24.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3e55f11e-0e4f-42b4-b000-2628fd5f289a roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122212024-11-14T09:12:24.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3e55f11e-0e4f-42b4-b000-2628fd5f289a resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122222024-11-14T09:12:24.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3e55f11e-0e4f-42b4-b000-2628fd5f289a response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122232024-11-14T09:12:25.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eac76dc4-c320-4e47-ac7b-e110625677a1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122242024-11-14T09:12:25.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eac76dc4-c320-4e47-ac7b-e110625677a1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122252024-11-14T09:12:25.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = eac76dc4-c320-4e47-ac7b-e110625677a1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122262024-11-14T09:12:25.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
122272024-11-14T09:12:25.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122282024-11-14T09:12:25.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
122292024-11-14T09:12:25.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122302024-11-14T09:12:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122312024-11-14T09:12:25.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122322024-11-14T09:12:25.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122332024-11-14T09:12:25.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122342024-11-14T09:12:25.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122352024-11-14T09:12:25.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.849342ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122362024-11-14T09:12:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122372024-11-14T09:12:25.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122382024-11-14T09:12:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122392024-11-14T09:12:25.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122402024-11-14T09:12:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122412024-11-14T09:12:25.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122422024-11-14T09:12:25.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
122432024-11-14T09:12:25.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122442024-11-14T09:12:25.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122452024-11-14T09:12:25.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
122462024-11-14T09:12:25.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.057941ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
122472024-11-14T09:12:26.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3ce46c5-f453-45dc-8cf7-1d4ea5705c05 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122482024-11-14T09:12:26.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3ce46c5-f453-45dc-8cf7-1d4ea5705c05 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122492024-11-14T09:12:26.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a3ce46c5-f453-45dc-8cf7-1d4ea5705c05 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122502024-11-14T09:12:27.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 61806aec-a836-4c6b-bc90-eb612d34d20c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122512024-11-14T09:12:27.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 61806aec-a836-4c6b-bc90-eb612d34d20c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122522024-11-14T09:12:27.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 61806aec-a836-4c6b-bc90-eb612d34d20c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122532024-11-14T09:12:28.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ce84329d-6109-49f9-8fd9-031fc9b62b5d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122542024-11-14T09:12:28.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ce84329d-6109-49f9-8fd9-031fc9b62b5d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122552024-11-14T09:12:28.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ce84329d-6109-49f9-8fd9-031fc9b62b5d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122562024-11-14T09:12:28.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = e7314dd1-f53c-4e03-b1dc-1e3582a12951 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
122572024-11-14T09:12:28.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = e7314dd1-f53c-4e03-b1dc-1e3582a12951 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
122582024-11-14T09:12:28.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = e7314dd1-f53c-4e03-b1dc-1e3582a12951 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
122592024-11-14T09:12:29.053ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1562 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 254bf52a-0624-4d6c-9d40-ba0ab18df8e2 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
122602024-11-14T09:12:29.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 57493ba0-bb92-4f27-9adf-43f2a47da385 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122612024-11-14T09:12:29.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 57493ba0-bb92-4f27-9adf-43f2a47da385 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122622024-11-14T09:12:29.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 57493ba0-bb92-4f27-9adf-43f2a47da385 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122632024-11-14T09:12:30.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b9c8b800-f7a4-4776-95f8-b13a6c93376b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122642024-11-14T09:12:30.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b9c8b800-f7a4-4776-95f8-b13a6c93376b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122652024-11-14T09:12:30.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b9c8b800-f7a4-4776-95f8-b13a6c93376b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122662024-11-14T09:12:31.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8dddf52c-ea78-409f-9b3d-e082a0ddabcc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122672024-11-14T09:12:31.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8dddf52c-ea78-409f-9b3d-e082a0ddabcc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122682024-11-14T09:12:31.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8dddf52c-ea78-409f-9b3d-e082a0ddabcc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122692024-11-14T09:12:32.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fad4ca35-2b93-4512-b02d-a5f6d1fd2936 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122702024-11-14T09:12:32.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fad4ca35-2b93-4512-b02d-a5f6d1fd2936 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122712024-11-14T09:12:32.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fad4ca35-2b93-4512-b02d-a5f6d1fd2936 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122722024-11-14T09:12:33.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa0d3ffe-1a1d-416c-9987-a8a0919fae06 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122732024-11-14T09:12:33.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa0d3ffe-1a1d-416c-9987-a8a0919fae06 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122742024-11-14T09:12:33.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = aa0d3ffe-1a1d-416c-9987-a8a0919fae06 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122752024-11-14T09:12:34.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80436636-bb85-48d5-8e87-9b6589119d2e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122762024-11-14T09:12:34.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80436636-bb85-48d5-8e87-9b6589119d2e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122772024-11-14T09:12:34.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 80436636-bb85-48d5-8e87-9b6589119d2e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122782024-11-14T09:12:35.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a709fbfb-85fe-4c81-b04f-ca0e23c3bd3e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122792024-11-14T09:12:35.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a709fbfb-85fe-4c81-b04f-ca0e23c3bd3e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122802024-11-14T09:12:35.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a709fbfb-85fe-4c81-b04f-ca0e23c3bd3e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
122812024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
122822024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122832024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
122842024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
122852024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
122862024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122872024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
122882024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
122892024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122902024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122912024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122922024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
122932024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
122942024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122952024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122962024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
122972024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
122982024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122992024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
123002024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123012024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
123022024-11-14T09:12:35.536ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
123032024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
123042024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123052024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
123062024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123072024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123082024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
123092024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
123102024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
123112024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
123122024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
123132024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123142024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
123152024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123162024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123172024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123182024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123192024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123202024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123212024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123222024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123232024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123242024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
123252024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123262024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123272024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
123282024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
123292024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123302024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123312024-11-14T09:12:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123322024-11-14T09:12:35.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123332024-11-14T09:12:35.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123342024-11-14T09:12:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123352024-11-14T09:12:35.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.298733ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
123362024-11-14T09:12:35.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1963, tv_nsec: 323218995 } })
123372024-11-14T09:12:35.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123382024-11-14T09:12:35.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
123392024-11-14T09:12:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
123402024-11-14T09:12:35.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123412024-11-14T09:12:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123422024-11-14T09:12:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123432024-11-14T09:12:35.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123442024-11-14T09:12:35.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123452024-11-14T09:12:35.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123462024-11-14T09:12:35.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123472024-11-14T09:12:35.545ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123482024-11-14T09:12:35.545ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123492024-11-14T09:12:35.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123502024-11-14T09:12:35.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123512024-11-14T09:12:35.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
123522024-11-14T09:12:35.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
123532024-11-14T09:12:35.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1963, tv_nsec: 328659762 } })
123542024-11-14T09:12:35.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123552024-11-14T09:12:35.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
123562024-11-14T09:12:35.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123572024-11-14T09:12:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123582024-11-14T09:12:35.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.067123ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
123592024-11-14T09:12:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123602024-11-14T09:12:35.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123612024-11-14T09:12:35.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123622024-11-14T09:12:35.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123632024-11-14T09:12:35.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123642024-11-14T09:12:35.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1963, tv_nsec: 334738820 } })
123652024-11-14T09:12:35.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123662024-11-14T09:12:35.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
123672024-11-14T09:12:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123682024-11-14T09:12:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
123692024-11-14T09:12:35.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123702024-11-14T09:12:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123712024-11-14T09:12:35.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123722024-11-14T09:12:35.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123732024-11-14T09:12:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123742024-11-14T09:12:35.556ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123752024-11-14T09:12:35.556ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123762024-11-14T09:12:35.556ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123772024-11-14T09:12:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123782024-11-14T09:12:35.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123792024-11-14T09:12:35.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123802024-11-14T09:12:35.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123812024-11-14T09:12:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123822024-11-14T09:12:35.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123832024-11-14T09:12:35.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123842024-11-14T09:12:35.560ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123852024-11-14T09:12:35.560ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123862024-11-14T09:12:35.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 24.513554ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123872024-11-14T09:12:35.561ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
123882024-11-14T09:12:35.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.362217ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
123892024-11-14T09:12:35.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123902024-11-14T09:12:35.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123912024-11-14T09:12:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123922024-11-14T09:12:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123932024-11-14T09:12:35.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123942024-11-14T09:12:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123952024-11-14T09:12:35.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123962024-11-14T09:12:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123972024-11-14T09:12:35.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123982024-11-14T09:12:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123992024-11-14T09:12:35.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124002024-11-14T09:12:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124012024-11-14T09:12:35.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.842913ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
124022024-11-14T09:12:35.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.188259ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124032024-11-14T09:12:35.590ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124042024-11-14T09:12:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
124052024-11-14T09:12:35.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124062024-11-14T09:12:35.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
124072024-11-14T09:12:35.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124082024-11-14T09:12:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124092024-11-14T09:12:35.609ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.319029ms iteration = 34 status = {"physical_disks_added":0}
124102024-11-14T09:12:35.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
124112024-11-14T09:12:35.631ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124122024-11-14T09:12:35.631ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b5c8bd1-c168-4670-b431-6da94075c193", "content-length": "26", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124132024-11-14T09:12:35.631ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124142024-11-14T09:12:35.632ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124152024-11-14T09:12:35.637ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
124162024-11-14T09:12:35.637ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124172024-11-14T09:12:35.637ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c513a20c-df9f-4f39-9d87-7d9a72819f26", "content-length": "26", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124182024-11-14T09:12:35.637ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124192024-11-14T09:12:35.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124202024-11-14T09:12:35.640ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
124212024-11-14T09:12:35.640ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124222024-11-14T09:12:35.641ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0767db6-1e91-4dd0-a22b-11d73e1c80d6", "content-length": "26", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124232024-11-14T09:12:35.641ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124242024-11-14T09:12:35.643ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
124252024-11-14T09:12:35.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124262024-11-14T09:12:35.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124272024-11-14T09:12:35.678ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
124282024-11-14T09:12:35.678ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124292024-11-14T09:12:35.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.711679ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124302024-11-14T09:12:35.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124312024-11-14T09:12:35.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124322024-11-14T09:12:35.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124332024-11-14T09:12:35.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124342024-11-14T09:12:35.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124352024-11-14T09:12:35.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124362024-11-14T09:12:35.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124372024-11-14T09:12:35.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
124382024-11-14T09:12:35.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124392024-11-14T09:12:35.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124402024-11-14T09:12:35.688ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 152.679583ms iteration = 30 status = 0
124412024-11-14T09:12:35.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
124422024-11-14T09:12:35.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 155.672721ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
124432024-11-14T09:12:35.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 171.589277ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
124442024-11-14T09:12:35.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124452024-11-14T09:12:35.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124462024-11-14T09:12:35.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124472024-11-14T09:12:35.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "349f7bb9-d9bb-4fb0-bed5-46d7cdce4251", "content-length": "372", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124482024-11-14T09:12:35.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124492024-11-14T09:12:35.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124502024-11-14T09:12:35.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124512024-11-14T09:12:35.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124522024-11-14T09:12:35.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124532024-11-14T09:12:35.733ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
124542024-11-14T09:12:35.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
124552024-11-14T09:12:35.738ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
124562024-11-14T09:12:35.738ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3455c65d-2a3b-4976-9a08-e2e487dad7b7", "content-length": "2", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124572024-11-14T09:12:35.739ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9388da6b-702a-42f3-b1a0-3bbb57e6a0b7", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124582024-11-14T09:12:35.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124592024-11-14T09:12:35.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124602024-11-14T09:12:35.740ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124612024-11-14T09:12:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124622024-11-14T09:12:35.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 204.682618ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
124632024-11-14T09:12:35.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124642024-11-14T09:12:35.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124652024-11-14T09:12:35.742ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.550729ms iteration = 30 status = null
124662024-11-14T09:12:35.766ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.015206ms iteration = 30 status = {}
124672024-11-14T09:12:35.799ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124682024-11-14T09:12:35.799ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "22e3d949-9f44-4ff3-a771-a6e67ee5a031", "content-length": "691", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124692024-11-14T09:12:35.799ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
124702024-11-14T09:12:35.799ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
124712024-11-14T09:12:35.799ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
124722024-11-14T09:12:35.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124732024-11-14T09:12:35.801ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 265.788501ms iteration = 31 status = {}
124742024-11-14T09:12:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124752024-11-14T09:12:35.805ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124762024-11-14T09:12:35.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124772024-11-14T09:12:35.805ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "24d5ee1c-1fb1-4e4b-88af-52f39c390fe6", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124782024-11-14T09:12:35.807ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.217247ms iteration = 32 status = {}
124792024-11-14T09:12:35.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124802024-11-14T09:12:35.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124812024-11-14T09:12:35.840ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
124822024-11-14T09:12:35.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124832024-11-14T09:12:35.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124842024-11-14T09:12:35.849ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124852024-11-14T09:12:35.849ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6f7918-bf70-4f8c-ba76-63e3b1d75c82", "content-length": "134", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
124862024-11-14T09:12:35.849ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124872024-11-14T09:12:35.849ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
124882024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124892024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124902024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124912024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124922024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124932024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124942024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124952024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124962024-11-14T09:12:35.850ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
124972024-11-14T09:12:35.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124982024-11-14T09:12:35.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124992024-11-14T09:12:35.852ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
125002024-11-14T09:12:35.852ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c13ea12-2090-4f04-83c1-f8f109dffa38", "content-length": "2", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
125012024-11-14T09:12:35.852ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
125022024-11-14T09:12:35.852ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2b5e9b-1203-444c-82bc-1fd9eaf83aa0", "content-length": "52", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
125032024-11-14T09:12:35.852ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
125042024-11-14T09:12:35.852ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
125052024-11-14T09:12:35.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8ec10543-82eb-429c-9a7f-901fbda9f90c", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
125062024-11-14T09:12:35.951ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
125072024-11-14T09:12:35.951ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
125082024-11-14T09:12:35.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "358f2563-7911-4881-b43f-3150131e711f", "content-length": "682", "date": "Thu, 14 Nov 2024 09:12:35 GMT"} })
125092024-11-14T09:12:35.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125102024-11-14T09:12:35.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125112024-11-14T09:12:35.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125122024-11-14T09:12:35.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125132024-11-14T09:12:35.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125142024-11-14T09:12:35.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125152024-11-14T09:12:35.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125162024-11-14T09:12:35.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125172024-11-14T09:12:35.969ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.666378ms iteration = 30 status = {}
125182024-11-14T09:12:36.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dec1ca64-3120-4a9b-bbec-7d1ee3a018a6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125192024-11-14T09:12:36.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dec1ca64-3120-4a9b-bbec-7d1ee3a018a6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125202024-11-14T09:12:36.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dec1ca64-3120-4a9b-bbec-7d1ee3a018a6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125212024-11-14T09:12:37.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12570fc1-0643-4bf2-bde3-d22edda9bdcb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125222024-11-14T09:12:37.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12570fc1-0643-4bf2-bde3-d22edda9bdcb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125232024-11-14T09:12:37.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 12570fc1-0643-4bf2-bde3-d22edda9bdcb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125242024-11-14T09:12:38.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 747fb824-ef1a-4aad-bfb2-272bf2ea3922 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125252024-11-14T09:12:38.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 747fb824-ef1a-4aad-bfb2-272bf2ea3922 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125262024-11-14T09:12:38.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 747fb824-ef1a-4aad-bfb2-272bf2ea3922 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125272024-11-14T09:12:39.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b010376-ea25-4ef3-b187-1c174a506c38 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125282024-11-14T09:12:39.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b010376-ea25-4ef3-b187-1c174a506c38 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125292024-11-14T09:12:39.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1b010376-ea25-4ef3-b187-1c174a506c38 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125302024-11-14T09:12:40.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 81fa8662-143b-423c-a3f0-4735c4315172 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125312024-11-14T09:12:40.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 81fa8662-143b-423c-a3f0-4735c4315172 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125322024-11-14T09:12:40.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 81fa8662-143b-423c-a3f0-4735c4315172 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125332024-11-14T09:12:41.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8f298923-2857-4943-a2fa-2d0c8c2ecc69 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125342024-11-14T09:12:41.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8f298923-2857-4943-a2fa-2d0c8c2ecc69 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125352024-11-14T09:12:41.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8f298923-2857-4943-a2fa-2d0c8c2ecc69 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125362024-11-14T09:12:42.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9629907e-47b3-4c65-8eb1-68a7d266e169 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125372024-11-14T09:12:42.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9629907e-47b3-4c65-8eb1-68a7d266e169 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125382024-11-14T09:12:42.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9629907e-47b3-4c65-8eb1-68a7d266e169 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125392024-11-14T09:12:43.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = db322619-cfb4-4047-8bc6-acb5c5facbae roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125402024-11-14T09:12:43.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = db322619-cfb4-4047-8bc6-acb5c5facbae resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125412024-11-14T09:12:43.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = db322619-cfb4-4047-8bc6-acb5c5facbae response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125422024-11-14T09:12:44.054ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 50a8f5a1-91a0-4d1d-bb15-9d22817ddd23 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
125432024-11-14T09:12:44.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2b549796-bc75-4ca1-88dc-4d0b046fcd69 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125442024-11-14T09:12:44.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2b549796-bc75-4ca1-88dc-4d0b046fcd69 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125452024-11-14T09:12:44.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2b549796-bc75-4ca1-88dc-4d0b046fcd69 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125462024-11-14T09:12:45.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
125472024-11-14T09:12:45.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125482024-11-14T09:12:45.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
125492024-11-14T09:12:45.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125502024-11-14T09:12:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125512024-11-14T09:12:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125522024-11-14T09:12:45.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125532024-11-14T09:12:45.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125542024-11-14T09:12:45.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125552024-11-14T09:12:45.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.016614ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125562024-11-14T09:12:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125572024-11-14T09:12:45.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125582024-11-14T09:12:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125592024-11-14T09:12:45.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125602024-11-14T09:12:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125612024-11-14T09:12:45.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125622024-11-14T09:12:45.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
125632024-11-14T09:12:45.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125642024-11-14T09:12:45.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125652024-11-14T09:12:45.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
125662024-11-14T09:12:45.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.965127ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
125672024-11-14T09:12:45.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 77210e1a-bfd5-48ec-be3c-e962d1d76b7d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125682024-11-14T09:12:45.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 77210e1a-bfd5-48ec-be3c-e962d1d76b7d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125692024-11-14T09:12:45.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 77210e1a-bfd5-48ec-be3c-e962d1d76b7d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125702024-11-14T09:12:46.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = db777a0a-9206-4c04-9f29-d0ae8eeb4b7c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125712024-11-14T09:12:46.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = db777a0a-9206-4c04-9f29-d0ae8eeb4b7c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125722024-11-14T09:12:46.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = db777a0a-9206-4c04-9f29-d0ae8eeb4b7c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125732024-11-14T09:12:47.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1fb9795-2162-4ca9-9eff-97ab1fbf8fdc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125742024-11-14T09:12:47.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1fb9795-2162-4ca9-9eff-97ab1fbf8fdc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125752024-11-14T09:12:47.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c1fb9795-2162-4ca9-9eff-97ab1fbf8fdc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125762024-11-14T09:12:48.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9384b0de-0921-49bb-83fd-19a4f35b0d5f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125772024-11-14T09:12:48.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9384b0de-0921-49bb-83fd-19a4f35b0d5f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125782024-11-14T09:12:48.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9384b0de-0921-49bb-83fd-19a4f35b0d5f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125792024-11-14T09:12:49.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 979f672d-148d-4be0-b78b-f0bb464c38b8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125802024-11-14T09:12:49.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 979f672d-148d-4be0-b78b-f0bb464c38b8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125812024-11-14T09:12:49.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 979f672d-148d-4be0-b78b-f0bb464c38b8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125822024-11-14T09:12:50.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ae07d2f-f49f-45d9-8d29-380f813175ea roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125832024-11-14T09:12:50.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ae07d2f-f49f-45d9-8d29-380f813175ea resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125842024-11-14T09:12:50.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5ae07d2f-f49f-45d9-8d29-380f813175ea response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125852024-11-14T09:12:51.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 51890ac9-07ed-4ad0-acd1-1e23afe271de roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125862024-11-14T09:12:51.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 51890ac9-07ed-4ad0-acd1-1e23afe271de resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125872024-11-14T09:12:51.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 51890ac9-07ed-4ad0-acd1-1e23afe271de response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125882024-11-14T09:12:52.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 892f45c3-9167-49d5-8063-d79c387c4855 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125892024-11-14T09:12:52.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 892f45c3-9167-49d5-8063-d79c387c4855 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125902024-11-14T09:12:52.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 892f45c3-9167-49d5-8063-d79c387c4855 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125912024-11-14T09:12:53.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11aa18ed-e808-4258-a8cb-f4bb5f8870af roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125922024-11-14T09:12:53.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11aa18ed-e808-4258-a8cb-f4bb5f8870af resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125932024-11-14T09:12:53.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 11aa18ed-e808-4258-a8cb-f4bb5f8870af response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125942024-11-14T09:12:54.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dd96224e-09eb-4c47-8a5f-01b7b4fa54a4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125952024-11-14T09:12:54.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dd96224e-09eb-4c47-8a5f-01b7b4fa54a4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125962024-11-14T09:12:54.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dd96224e-09eb-4c47-8a5f-01b7b4fa54a4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
125972024-11-14T09:12:55.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
125982024-11-14T09:12:55.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
125992024-11-14T09:12:55.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126002024-11-14T09:12:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126012024-11-14T09:12:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126022024-11-14T09:12:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126032024-11-14T09:12:55.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126042024-11-14T09:12:55.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126052024-11-14T09:12:55.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126062024-11-14T09:12:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126072024-11-14T09:12:55.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126082024-11-14T09:12:55.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126092024-11-14T09:12:55.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.747097ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126102024-11-14T09:12:55.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126112024-11-14T09:12:55.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126122024-11-14T09:12:55.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126132024-11-14T09:12:55.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
126142024-11-14T09:12:55.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126152024-11-14T09:12:55.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126162024-11-14T09:12:55.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
126172024-11-14T09:12:55.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.301813ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
126182024-11-14T09:12:55.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 22cbf480-0359-4705-8dd4-6b53e7fe46f4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126192024-11-14T09:12:55.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 22cbf480-0359-4705-8dd4-6b53e7fe46f4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126202024-11-14T09:12:55.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 22cbf480-0359-4705-8dd4-6b53e7fe46f4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126212024-11-14T09:12:56.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 90ad7d3d-265a-48a3-9c6f-95acb8a76a34 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126222024-11-14T09:12:56.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 90ad7d3d-265a-48a3-9c6f-95acb8a76a34 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126232024-11-14T09:12:56.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 90ad7d3d-265a-48a3-9c6f-95acb8a76a34 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126242024-11-14T09:12:57.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3191d477-1b77-4620-a973-ae1b13de1968 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126252024-11-14T09:12:57.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3191d477-1b77-4620-a973-ae1b13de1968 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126262024-11-14T09:12:57.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3191d477-1b77-4620-a973-ae1b13de1968 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126272024-11-14T09:12:58.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 43a3e8a0-b177-45af-97de-36bd92a062c4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126282024-11-14T09:12:58.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 43a3e8a0-b177-45af-97de-36bd92a062c4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126292024-11-14T09:12:58.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 43a3e8a0-b177-45af-97de-36bd92a062c4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126302024-11-14T09:12:58.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b8c63ec-2c78-4589-a418-82370c9f68d8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126312024-11-14T09:12:58.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b8c63ec-2c78-4589-a418-82370c9f68d8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126322024-11-14T09:12:58.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8b8c63ec-2c78-4589-a418-82370c9f68d8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126332024-11-14T09:12:59.053ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 6c62ce30-2ba1-4046-af6a-a0f48f396357 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
126342024-11-14T09:12:59.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dbb0cf4c-b9a0-4791-8cdf-bd134a2ad5a7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126352024-11-14T09:12:59.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dbb0cf4c-b9a0-4791-8cdf-bd134a2ad5a7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126362024-11-14T09:12:59.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = dbb0cf4c-b9a0-4791-8cdf-bd134a2ad5a7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126372024-11-14T09:13:00.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e71607d6-27dc-4f72-8006-ad5b613949c7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126382024-11-14T09:13:00.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e71607d6-27dc-4f72-8006-ad5b613949c7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126392024-11-14T09:13:00.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e71607d6-27dc-4f72-8006-ad5b613949c7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126402024-11-14T09:13:01.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 622c5568-08e6-4844-87b8-2c2988631c7c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126412024-11-14T09:13:01.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 622c5568-08e6-4844-87b8-2c2988631c7c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126422024-11-14T09:13:01.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 622c5568-08e6-4844-87b8-2c2988631c7c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126432024-11-14T09:13:02.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05ebef7b-94be-4fe2-9e3a-3830381507b6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126442024-11-14T09:13:02.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05ebef7b-94be-4fe2-9e3a-3830381507b6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126452024-11-14T09:13:02.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05ebef7b-94be-4fe2-9e3a-3830381507b6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126462024-11-14T09:13:03.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 938eb0ad-f246-4f1a-9b2b-52209d3462d1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126472024-11-14T09:13:03.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 938eb0ad-f246-4f1a-9b2b-52209d3462d1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126482024-11-14T09:13:04.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 938eb0ad-f246-4f1a-9b2b-52209d3462d1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126492024-11-14T09:13:04.044ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:63126
126502024-11-14T09:13:04.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = d5e873c4-6b59-429f-90a3-bf07abeccfe5 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
126512024-11-14T09:13:04.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = d5e873c4-6b59-429f-90a3-bf07abeccfe5 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
126522024-11-14T09:13:04.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = d5e873c4-6b59-429f-90a3-bf07abeccfe5 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
126532024-11-14T09:13:04.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 82f8fda1-e637-4dba-88a5-adf86cb36b11 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
126542024-11-14T09:13:04.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 82f8fda1-e637-4dba-88a5-adf86cb36b11 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
126552024-11-14T09:13:04.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 82f8fda1-e637-4dba-88a5-adf86cb36b11 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
126562024-11-14T09:13:05.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c875d36-1086-480f-8f08-01a7e7f36633 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126572024-11-14T09:13:05.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c875d36-1086-480f-8f08-01a7e7f36633 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126582024-11-14T09:13:05.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8c875d36-1086-480f-8f08-01a7e7f36633 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
126592024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
126602024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126612024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
126622024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126632024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
126642024-11-14T09:13:05.536ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 09:03:05.536548162 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
126652024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
126662024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
126672024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126682024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
126692024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
126702024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126712024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
126722024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126732024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
126742024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
126752024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126762024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126772024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
126782024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126792024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
126802024-11-14T09:13:05.536ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
126812024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
126822024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
126832024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
126842024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126852024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126862024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
126872024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
126882024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
126892024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
126902024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
126912024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
126922024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
126932024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
126942024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
126952024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
126962024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
126972024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126982024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
126992024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
127002024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
127012024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127022024-11-14T09:13:05.536ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
127032024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
127042024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
127052024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127062024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
127072024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127082024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
127092024-11-14T09:13:05.537ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127102024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127112024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
127122024-11-14T09:13:05.537ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
127132024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
127142024-11-14T09:13:05.537ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
127152024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.901\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
127162024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127172024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
127182024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
127192024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
127202024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
127212024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127222024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127232024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
127242024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
127252024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127262024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127272024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
127282024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
127292024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
127302024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127312024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127322024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
127332024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127342024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127352024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127362024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
127372024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127382024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127392024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
127402024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
127412024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127422024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127432024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
127442024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
127452024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127462024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127472024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127482024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127492024-11-14T09:13:05.537ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1993, tv_nsec: 319555196 } })
127502024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127512024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127522024-11-14T09:13:05.537ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1993, tv_nsec: 319633847 } })
127532024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127542024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127552024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127562024-11-14T09:13:05.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127572024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127582024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127592024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
127602024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.191369ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
127612024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
127622024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.617906ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
127632024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127642024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127652024-11-14T09:13:05.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127662024-11-14T09:13:05.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.09847ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127672024-11-14T09:13:05.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1993, tv_nsec: 321932764 } })
127682024-11-14T09:13:05.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
127692024-11-14T09:13:05.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127702024-11-14T09:13:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
127712024-11-14T09:13:05.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
127722024-11-14T09:13:05.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
127732024-11-14T09:13:05.543ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 09:03:05.536548162 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
127742024-11-14T09:13:05.544ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.449319ms iteration = 16 status = {"expiration":"2024-11-14T09:03:05.536548162Z","pruned":[]}
127752024-11-14T09:13:05.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127762024-11-14T09:13:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127772024-11-14T09:13:05.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127782024-11-14T09:13:05.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127792024-11-14T09:13:05.547ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.541969ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
127802024-11-14T09:13:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127812024-11-14T09:13:05.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127822024-11-14T09:13:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127832024-11-14T09:13:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127842024-11-14T09:13:05.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127852024-11-14T09:13:05.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127862024-11-14T09:13:05.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127872024-11-14T09:13:05.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1993, tv_nsec: 334600658 } })
127882024-11-14T09:13:05.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
127892024-11-14T09:13:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127902024-11-14T09:13:05.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127912024-11-14T09:13:05.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127922024-11-14T09:13:05.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.339589ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
127932024-11-14T09:13:05.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127942024-11-14T09:13:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127952024-11-14T09:13:05.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127962024-11-14T09:13:05.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127972024-11-14T09:13:05.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127982024-11-14T09:13:05.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
127992024-11-14T09:13:05.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128002024-11-14T09:13:05.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128012024-11-14T09:13:05.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128022024-11-14T09:13:05.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128032024-11-14T09:13:05.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128042024-11-14T09:13:05.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128052024-11-14T09:13:05.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128062024-11-14T09:13:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128072024-11-14T09:13:05.562ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128082024-11-14T09:13:05.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128092024-11-14T09:13:05.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128102024-11-14T09:13:05.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 29.379252ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
128112024-11-14T09:13:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128122024-11-14T09:13:05.568ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128132024-11-14T09:13:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128142024-11-14T09:13:05.568ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128152024-11-14T09:13:05.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128162024-11-14T09:13:05.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128172024-11-14T09:13:05.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128182024-11-14T09:13:05.571ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128192024-11-14T09:13:05.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128202024-11-14T09:13:05.571ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128212024-11-14T09:13:05.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128222024-11-14T09:13:05.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128232024-11-14T09:13:05.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128242024-11-14T09:13:05.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128252024-11-14T09:13:05.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128262024-11-14T09:13:05.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128272024-11-14T09:13:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128282024-11-14T09:13:05.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
128292024-11-14T09:13:05.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1993, tv_nsec: 361627522 } })
128302024-11-14T09:13:05.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
128312024-11-14T09:13:05.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
128322024-11-14T09:13:05.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.977339ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
128332024-11-14T09:13:05.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128342024-11-14T09:13:05.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128352024-11-14T09:13:05.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128362024-11-14T09:13:05.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128372024-11-14T09:13:05.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128382024-11-14T09:13:05.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128392024-11-14T09:13:05.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
128402024-11-14T09:13:05.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128412024-11-14T09:13:05.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128422024-11-14T09:13:05.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128432024-11-14T09:13:05.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
128442024-11-14T09:13:05.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128452024-11-14T09:13:05.598ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
128462024-11-14T09:13:05.598ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
128472024-11-14T09:13:05.598ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
128482024-11-14T09:13:05.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128492024-11-14T09:13:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128502024-11-14T09:13:05.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.309877ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128512024-11-14T09:13:05.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
128522024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
128532024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128542024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128552024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128562024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
128572024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128582024-11-14T09:13:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128592024-11-14T09:13:05.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128602024-11-14T09:13:05.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128612024-11-14T09:13:05.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
128622024-11-14T09:13:05.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128632024-11-14T09:13:05.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128642024-11-14T09:13:05.604ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
128652024-11-14T09:13:05.604ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
128662024-11-14T09:13:05.604ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.654427ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
128672024-11-14T09:13:05.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128682024-11-14T09:13:05.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128692024-11-14T09:13:05.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128702024-11-14T09:13:05.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128712024-11-14T09:13:05.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128722024-11-14T09:13:05.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
128732024-11-14T09:13:05.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128742024-11-14T09:13:05.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
128752024-11-14T09:13:05.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128762024-11-14T09:13:05.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128772024-11-14T09:13:05.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128782024-11-14T09:13:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
128792024-11-14T09:13:05.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128802024-11-14T09:13:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128812024-11-14T09:13:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
128822024-11-14T09:13:05.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128832024-11-14T09:13:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128842024-11-14T09:13:05.616ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
128852024-11-14T09:13:05.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
128862024-11-14T09:13:05.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128872024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128882024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128892024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128902024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.631663ms iteration = 35 status = {"physical_disks_added":0}
128912024-11-14T09:13:05.620ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128922024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128932024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128942024-11-14T09:13:05.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128952024-11-14T09:13:05.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128962024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128972024-11-14T09:13:05.623ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
128982024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
128992024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
129002024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.846146ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
129012024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129022024-11-14T09:13:05.623ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129032024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129042024-11-14T09:13:05.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129052024-11-14T09:13:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129062024-11-14T09:13:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129072024-11-14T09:13:05.624ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
129082024-11-14T09:13:05.624ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
129092024-11-14T09:13:05.624ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.193607ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
129102024-11-14T09:13:05.625ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129112024-11-14T09:13:05.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129122024-11-14T09:13:05.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129132024-11-14T09:13:05.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129142024-11-14T09:13:05.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129152024-11-14T09:13:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
129162024-11-14T09:13:05.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129172024-11-14T09:13:05.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129182024-11-14T09:13:05.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129192024-11-14T09:13:05.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
129202024-11-14T09:13:05.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.70441ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
129212024-11-14T09:13:05.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129222024-11-14T09:13:05.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129232024-11-14T09:13:05.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129242024-11-14T09:13:05.635ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
129252024-11-14T09:13:05.635ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
129262024-11-14T09:13:05.635ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
129272024-11-14T09:13:05.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129282024-11-14T09:13:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129292024-11-14T09:13:05.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129302024-11-14T09:13:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129312024-11-14T09:13:05.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129322024-11-14T09:13:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129332024-11-14T09:13:05.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
129342024-11-14T09:13:05.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129352024-11-14T09:13:05.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129362024-11-14T09:13:05.673ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129372024-11-14T09:13:05.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129382024-11-14T09:13:05.686ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
129392024-11-14T09:13:05.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129402024-11-14T09:13:05.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129412024-11-14T09:13:05.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
129422024-11-14T09:13:05.735ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129432024-11-14T09:13:05.735ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84cb9005-c9a4-4ecf-a3af-ebc9dd81ed92", "content-length": "26", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
129442024-11-14T09:13:05.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129452024-11-14T09:13:05.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129462024-11-14T09:13:05.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
129472024-11-14T09:13:05.821ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129482024-11-14T09:13:05.821ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7260185-c0d1-4819-a6e6-d4d8115c5165", "content-length": "26", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
129492024-11-14T09:13:05.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129502024-11-14T09:13:05.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129512024-11-14T09:13:05.839ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
129522024-11-14T09:13:05.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
129532024-11-14T09:13:05.845ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "87d4b1ab-abaf-4a41-a678-cc0bd5cac973", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129542024-11-14T09:13:05.845ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129552024-11-14T09:13:05.847ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "da009e68-27ed-40fa-9302-dd11829234bd", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129562024-11-14T09:13:05.847ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129572024-11-14T09:13:05.848ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129582024-11-14T09:13:05.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 311.845661ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
129592024-11-14T09:13:05.854ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
129602024-11-14T09:13:05.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129612024-11-14T09:13:05.857ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 320.381497ms iteration = 7 status = {"nsuccess":5}
129622024-11-14T09:13:05.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 320.461028ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129632024-11-14T09:13:05.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129642024-11-14T09:13:05.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129652024-11-14T09:13:05.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129662024-11-14T09:13:05.858ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
129672024-11-14T09:13:05.858ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
129682024-11-14T09:13:05.858ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
129692024-11-14T09:13:05.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 321.439435ms iteration = 17 status = {"generation":2}
129702024-11-14T09:13:05.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "232ae172-3786-4766-8adb-173770499a97", "content-length": "372", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
129712024-11-14T09:13:05.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129722024-11-14T09:13:05.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129732024-11-14T09:13:05.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129742024-11-14T09:13:05.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129752024-11-14T09:13:05.860ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
129762024-11-14T09:13:05.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 323.64747ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
129772024-11-14T09:13:05.861ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
129782024-11-14T09:13:05.861ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129792024-11-14T09:13:05.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129802024-11-14T09:13:05.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129812024-11-14T09:13:05.861ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eb054cc-ba85-4a5d-a918-46000a211485", "content-length": "26", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
129822024-11-14T09:13:05.861ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129832024-11-14T09:13:05.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129842024-11-14T09:13:05.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129852024-11-14T09:13:05.863ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
129862024-11-14T09:13:05.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129872024-11-14T09:13:05.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129882024-11-14T09:13:05.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129892024-11-14T09:13:05.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129902024-11-14T09:13:05.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
129912024-11-14T09:13:05.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129922024-11-14T09:13:05.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129932024-11-14T09:13:05.875ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 338.845553ms iteration = 31 status = 0
129942024-11-14T09:13:05.890ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129952024-11-14T09:13:05.890ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
129962024-11-14T09:13:05.890ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 353.032782ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
129972024-11-14T09:13:05.898ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
129982024-11-14T09:13:05.898ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
129992024-11-14T09:13:05.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130002024-11-14T09:13:05.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130012024-11-14T09:13:05.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130022024-11-14T09:13:05.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130032024-11-14T09:13:05.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130042024-11-14T09:13:05.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130052024-11-14T09:13:05.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130062024-11-14T09:13:05.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130072024-11-14T09:13:05.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130082024-11-14T09:13:05.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 368.294618ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
130092024-11-14T09:13:05.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130102024-11-14T09:13:05.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130112024-11-14T09:13:05.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130122024-11-14T09:13:05.910ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
130132024-11-14T09:13:05.910ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 374.07703ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
130142024-11-14T09:13:05.915ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
130152024-11-14T09:13:05.915ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
130162024-11-14T09:13:05.915ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
130172024-11-14T09:13:05.915ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 378.230816ms iteration = 17 status = {"generation":1}
130182024-11-14T09:13:05.925ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
130192024-11-14T09:13:05.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
130202024-11-14T09:13:05.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47e0dc3f-7f17-4a81-b312-1df5cbbad449", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
130212024-11-14T09:13:05.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130222024-11-14T09:13:05.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130232024-11-14T09:13:05.928ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
130242024-11-14T09:13:05.928ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "66eacb93-2920-4a07-abb5-f1fec7b28d8c", "content-length": "2", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
130252024-11-14T09:13:05.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130262024-11-14T09:13:05.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130272024-11-14T09:13:05.930ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130282024-11-14T09:13:05.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130292024-11-14T09:13:05.932ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 395.615356ms iteration = 31 status = null
130302024-11-14T09:13:05.932ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130312024-11-14T09:13:05.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130322024-11-14T09:13:05.942ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
130332024-11-14T09:13:05.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130342024-11-14T09:13:05.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130352024-11-14T09:13:05.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ca86d2ad-8426-4251-922f-2fe74ba11734", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
130362024-11-14T09:13:05.944ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 407.714111ms iteration = 33 status = {}
130372024-11-14T09:13:05.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130382024-11-14T09:13:05.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
130392024-11-14T09:13:05.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130402024-11-14T09:13:05.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130412024-11-14T09:13:05.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130422024-11-14T09:13:05.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130432024-11-14T09:13:05.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130442024-11-14T09:13:05.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130452024-11-14T09:13:05.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130462024-11-14T09:13:05.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130472024-11-14T09:13:05.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130482024-11-14T09:13:05.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130492024-11-14T09:13:05.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130502024-11-14T09:13:05.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130512024-11-14T09:13:05.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130522024-11-14T09:13:05.974ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
130532024-11-14T09:13:05.974ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6026a025-b650-49f8-8fc8-487c7bdd8da3", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130542024-11-14T09:13:05.974ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130552024-11-14T09:13:05.977ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e8ac3cfd-5639-430d-b65d-c51cb875ab1a", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130562024-11-14T09:13:05.977ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130572024-11-14T09:13:05.978ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "23de31b9-60c3-46d2-b0c2-dc390e18bf52", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130582024-11-14T09:13:05.978ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130592024-11-14T09:13:05.980ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
130602024-11-14T09:13:05.980ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 443.724969ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
130612024-11-14T09:13:05.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130622024-11-14T09:13:05.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130632024-11-14T09:13:05.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130642024-11-14T09:13:05.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130652024-11-14T09:13:05.990ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.585218ms iteration = 31 status = {}
130662024-11-14T09:13:05.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130672024-11-14T09:13:05.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
130682024-11-14T09:13:05.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130692024-11-14T09:13:05.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130702024-11-14T09:13:05.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130712024-11-14T09:13:05.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130722024-11-14T09:13:05.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130732024-11-14T09:13:05.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130742024-11-14T09:13:06.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130752024-11-14T09:13:06.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130762024-11-14T09:13:06.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130772024-11-14T09:13:06.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130782024-11-14T09:13:06.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130792024-11-14T09:13:06.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130802024-11-14T09:13:06.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130812024-11-14T09:13:06.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130822024-11-14T09:13:06.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130832024-11-14T09:13:06.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
130842024-11-14T09:13:06.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130852024-11-14T09:13:06.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130862024-11-14T09:13:06.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130872024-11-14T09:13:06.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130882024-11-14T09:13:06.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130892024-11-14T09:13:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130902024-11-14T09:13:06.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130912024-11-14T09:13:06.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97bcc223-8607-4a81-bfe0-ce99293ec972 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
130922024-11-14T09:13:06.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97bcc223-8607-4a81-bfe0-ce99293ec972 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
130932024-11-14T09:13:06.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
130942024-11-14T09:13:06.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130952024-11-14T09:13:06.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130962024-11-14T09:13:06.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
130972024-11-14T09:13:06.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6723bad9-6832-4d86-a7d3-fc697457f6c0", "content-length": "691", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
130982024-11-14T09:13:06.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
130992024-11-14T09:13:06.072ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
131002024-11-14T09:13:06.072ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
131012024-11-14T09:13:06.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 97bcc223-8607-4a81-bfe0-ce99293ec972 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131022024-11-14T09:13:06.075ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 538.640604ms iteration = 32 status = {}
131032024-11-14T09:13:06.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131042024-11-14T09:13:06.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131052024-11-14T09:13:06.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131062024-11-14T09:13:06.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131072024-11-14T09:13:06.080ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
131082024-11-14T09:13:06.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131092024-11-14T09:13:06.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131102024-11-14T09:13:06.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131112024-11-14T09:13:06.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131122024-11-14T09:13:06.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131132024-11-14T09:13:06.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131142024-11-14T09:13:06.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131152024-11-14T09:13:06.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131162024-11-14T09:13:06.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131172024-11-14T09:13:06.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131182024-11-14T09:13:06.089ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131192024-11-14T09:13:06.090ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "758fd4c6-ba84-4733-a9a0-bcbe40887b33", "content-length": "134", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
131202024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131212024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
131222024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131232024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131242024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131252024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131262024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131272024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131282024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131292024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131302024-11-14T09:13:06.090ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
131312024-11-14T09:13:06.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131322024-11-14T09:13:06.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131332024-11-14T09:13:06.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131342024-11-14T09:13:06.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c853e40b-b014-4fe7-bfb2-2babe81d382f", "content-length": "2", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
131352024-11-14T09:13:06.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131362024-11-14T09:13:06.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02719d5-d52d-4588-8bc6-ca5df3fbcf22", "content-length": "52", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
131372024-11-14T09:13:06.092ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
131382024-11-14T09:13:06.092ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131392024-11-14T09:13:06.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131402024-11-14T09:13:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131412024-11-14T09:13:06.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131422024-11-14T09:13:06.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131432024-11-14T09:13:06.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131442024-11-14T09:13:06.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
131452024-11-14T09:13:06.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131462024-11-14T09:13:06.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131472024-11-14T09:13:06.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131482024-11-14T09:13:06.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131492024-11-14T09:13:06.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131502024-11-14T09:13:06.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131512024-11-14T09:13:06.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131522024-11-14T09:13:06.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
131532024-11-14T09:13:06.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131542024-11-14T09:13:06.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131552024-11-14T09:13:06.165ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
131562024-11-14T09:13:06.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131572024-11-14T09:13:06.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131582024-11-14T09:13:06.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131592024-11-14T09:13:06.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
131602024-11-14T09:13:06.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131612024-11-14T09:13:06.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131622024-11-14T09:13:06.170ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
131632024-11-14T09:13:06.170ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 208292a9-20b7-485e-95b8-8fa301192abc, kind: Service { id: ef32bdd5-939a-4ab0-a70a-6f004e97691b }, name: Name("external-dns-ef32bdd5-939a-4ab0-a70a-6f004e97691b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 49])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b6a42b1-a060-4782-a598-da956f0e54bf, kind: Service { id: e0fbd02e-9643-47c5-9261-dd03abc268a8 }, name: Name("external-dns-e0fbd02e-9643-47c5-9261-dd03abc268a8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3d08f9bf-1395-4918-83ef-e9bf23bb54cc, kind: Service { id: d3dd4036-6839-48d6-8f36-e642d9b3e6c0 }, name: Name("nexus-d3dd4036-6839-48d6-8f36-e642d9b3e6c0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 97])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eb09bf8b-0a0a-43d0-8fab-de971f1991ea, kind: Service { id: b933d23e-28f4-4f5e-9ad9-9694702ed335 }, name: Name("nexus-b933d23e-28f4-4f5e-9ad9-9694702ed335"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f73311b5-bba3-40b6-b24a-8c3229a71a49, kind: Service { id: 484a1c50-302f-49ec-9214-2179c2ff7104 }, name: Name("nexus-484a1c50-302f-49ec-9214-2179c2ff7104"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 0])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
131642024-11-14T09:13:06.170ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
131652024-11-14T09:13:06.201ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9576bab7-1aa0-4c81-b43e-459f85f36adf", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
131662024-11-14T09:13:06.201ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
131672024-11-14T09:13:06.201ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131682024-11-14T09:13:06.201ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "abcaf6a6-c941-4f55-ba7b-165b39933995", "content-length": "682", "date": "Thu, 14 Nov 2024 09:13:05 GMT"} })
131692024-11-14T09:13:06.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131702024-11-14T09:13:06.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131712024-11-14T09:13:06.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131722024-11-14T09:13:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131732024-11-14T09:13:06.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131742024-11-14T09:13:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131752024-11-14T09:13:06.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131762024-11-14T09:13:06.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131772024-11-14T09:13:06.217ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 681.063722ms iteration = 31 status = {}
131782024-11-14T09:13:06.279ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 65d2236a-3110-4d84-aa25-77e21779db87, time_created: 2024-11-14T08:58:18.385723Z, time_modified: 2024-11-14T08:58:18.385723Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
131792024-11-14T09:13:06.279ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
131802024-11-14T09:13:06.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131812024-11-14T09:13:06.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131822024-11-14T09:13:06.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131832024-11-14T09:13:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131842024-11-14T09:13:06.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131852024-11-14T09:13:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
131862024-11-14T09:13:06.315ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
131872024-11-14T09:13:06.316ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6e18aa5f-c908-4662-b4be-0f761ccca98d", "date": "Thu, 14 Nov 2024 09:13:06 GMT"} })
131882024-11-14T09:13:06.317ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
131892024-11-14T09:13:06.317ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 780.080762ms
131902024-11-14T09:13:06.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 780.090462ms iteration = 4 status = {}
131912024-11-14T09:13:07.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1acd040c-b407-4f97-953a-dfc611301839 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131922024-11-14T09:13:07.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1acd040c-b407-4f97-953a-dfc611301839 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131932024-11-14T09:13:07.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1acd040c-b407-4f97-953a-dfc611301839 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131942024-11-14T09:13:08.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4aea7cc-ac88-4c47-8c6a-471b5e78a352 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131952024-11-14T09:13:08.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4aea7cc-ac88-4c47-8c6a-471b5e78a352 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131962024-11-14T09:13:08.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4aea7cc-ac88-4c47-8c6a-471b5e78a352 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
131972024-11-14T09:13:09.241ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49602
131982024-11-14T09:13:09.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49602 req_id = 9ef31afd-4d6d-4bd9-ac4c-594a075f8cc2 roles = RoleSet { roles: {} } uri = /metrics/producers
131992024-11-14T09:13:09.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49602 req_id = 9ef31afd-4d6d-4bd9-ac4c-594a075f8cc2 resource = Database result = Ok(()) uri = /metrics/producers
132002024-11-14T09:13:09.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83af0452-5a94-420b-984b-02f98c3c9bea roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132012024-11-14T09:13:09.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83af0452-5a94-420b-984b-02f98c3c9bea resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132022024-11-14T09:13:09.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 83af0452-5a94-420b-984b-02f98c3c9bea response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132032024-11-14T09:13:09.293ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 90e4e05f-b4bf-4b2e-9770-f73b3d2c05fa
132042024-11-14T09:13:09.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51839 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49602 req_id = 9ef31afd-4d6d-4bd9-ac4c-594a075f8cc2 response_code = 201 uri = /metrics/producers
132052024-11-14T09:13:09.983ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40818
132062024-11-14T09:13:09.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40818 req_id = d2a1d3bb-d066-42a4-8cb1-5b7a03c85db7 roles = RoleSet { roles: {} } uri = /metrics/producers
132072024-11-14T09:13:09.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40818 req_id = d2a1d3bb-d066-42a4-8cb1-5b7a03c85db7 resource = Database result = Ok(()) uri = /metrics/producers
132082024-11-14T09:13:10.007ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 0a0adcc5-bcdd-46d2-a222-ace3abfe409c
132092024-11-14T09:13:10.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23491 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40818 req_id = d2a1d3bb-d066-42a4-8cb1-5b7a03c85db7 response_code = 201 uri = /metrics/producers
132102024-11-14T09:13:10.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3303ae96-0cd4-4693-8dd7-bfed0dd1661b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132112024-11-14T09:13:10.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3303ae96-0cd4-4693-8dd7-bfed0dd1661b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132122024-11-14T09:13:10.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3303ae96-0cd4-4693-8dd7-bfed0dd1661b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132132024-11-14T09:13:11.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d319b3d0-8da3-4d33-b5a3-17433cb852e5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132142024-11-14T09:13:11.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d319b3d0-8da3-4d33-b5a3-17433cb852e5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132152024-11-14T09:13:11.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d319b3d0-8da3-4d33-b5a3-17433cb852e5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132162024-11-14T09:13:12.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 185535da-6116-4ae8-94aa-5825e4b1eb10 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132172024-11-14T09:13:12.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 185535da-6116-4ae8-94aa-5825e4b1eb10 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132182024-11-14T09:13:12.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 185535da-6116-4ae8-94aa-5825e4b1eb10 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132192024-11-14T09:13:13.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e88b3891-8446-4e88-8994-2c3167a0d889 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132202024-11-14T09:13:13.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e88b3891-8446-4e88-8994-2c3167a0d889 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132212024-11-14T09:13:13.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e88b3891-8446-4e88-8994-2c3167a0d889 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132222024-11-14T09:13:14.053ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 8ecd00fa-ec9a-4fa0-96b5-c79c4af82a03 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
132232024-11-14T09:13:14.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 647fd6a6-5d12-48c6-90fa-d05bcac0348b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132242024-11-14T09:13:14.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 647fd6a6-5d12-48c6-90fa-d05bcac0348b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132252024-11-14T09:13:14.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 647fd6a6-5d12-48c6-90fa-d05bcac0348b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132262024-11-14T09:13:15.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05b6ae1a-b2f2-4e19-b2e2-ca751292c9d9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132272024-11-14T09:13:15.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05b6ae1a-b2f2-4e19-b2e2-ca751292c9d9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132282024-11-14T09:13:15.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 05b6ae1a-b2f2-4e19-b2e2-ca751292c9d9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132292024-11-14T09:13:15.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
132302024-11-14T09:13:15.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
132312024-11-14T09:13:15.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132322024-11-14T09:13:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132332024-11-14T09:13:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132342024-11-14T09:13:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132352024-11-14T09:13:15.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132362024-11-14T09:13:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132372024-11-14T09:13:15.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132382024-11-14T09:13:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132392024-11-14T09:13:15.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132402024-11-14T09:13:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132412024-11-14T09:13:15.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132422024-11-14T09:13:15.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
132432024-11-14T09:13:15.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132442024-11-14T09:13:15.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132452024-11-14T09:13:15.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
132462024-11-14T09:13:15.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.355695ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
132472024-11-14T09:13:15.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132482024-11-14T09:13:15.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132492024-11-14T09:13:15.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.746647ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132502024-11-14T09:13:15.880ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:40201
132512024-11-14T09:13:15.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40201 req_id = aa1405db-38e6-4f5e-8ad7-86303dd94b6d roles = RoleSet { roles: {} } uri = /metrics/producers
132522024-11-14T09:13:15.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40201 req_id = aa1405db-38e6-4f5e-8ad7-86303dd94b6d resource = Database result = Ok(()) uri = /metrics/producers
132532024-11-14T09:13:15.946ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 4ceca43a-03cf-4e69-8d70-2c7628b44304
132542024-11-14T09:13:15.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66589 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40201 req_id = aa1405db-38e6-4f5e-8ad7-86303dd94b6d response_code = 201 uri = /metrics/producers
132552024-11-14T09:13:16.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ccc0c354-82ea-45e5-a3bf-0e0e8d260b1e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132562024-11-14T09:13:16.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ccc0c354-82ea-45e5-a3bf-0e0e8d260b1e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132572024-11-14T09:13:16.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ccc0c354-82ea-45e5-a3bf-0e0e8d260b1e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132582024-11-14T09:13:17.292ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50617
132592024-11-14T09:13:17.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50617 req_id = 3a1e69f2-8efb-493e-8c5e-4b6c9b46194d roles = RoleSet { roles: {} } uri = /metrics/producers
132602024-11-14T09:13:17.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50617 req_id = 3a1e69f2-8efb-493e-8c5e-4b6c9b46194d resource = Database result = Ok(()) uri = /metrics/producers
132612024-11-14T09:13:17.338ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 65d2236a-3110-4d84-aa25-77e21779db87
132622024-11-14T09:13:17.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45878 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50617 req_id = 3a1e69f2-8efb-493e-8c5e-4b6c9b46194d response_code = 201 uri = /metrics/producers
132632024-11-14T09:13:17.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4d0c94de-4c5a-410f-a785-b01683f19725 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132642024-11-14T09:13:17.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4d0c94de-4c5a-410f-a785-b01683f19725 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132652024-11-14T09:13:17.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4d0c94de-4c5a-410f-a785-b01683f19725 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132662024-11-14T09:13:18.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f75b320b-0e88-4c3b-8a00-221b5b19fdbe roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132672024-11-14T09:13:18.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f75b320b-0e88-4c3b-8a00-221b5b19fdbe resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132682024-11-14T09:13:18.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f75b320b-0e88-4c3b-8a00-221b5b19fdbe response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132692024-11-14T09:13:18.871ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35274
132702024-11-14T09:13:18.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35274 req_id = 2dca9e78-f652-4819-85ca-57f98d7e4a8f roles = RoleSet { roles: {} } uri = /metrics/producers
132712024-11-14T09:13:18.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35274 req_id = 2dca9e78-f652-4819-85ca-57f98d7e4a8f resource = Database result = Ok(()) uri = /metrics/producers
132722024-11-14T09:13:18.882ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 92786f50-3ada-49c6-9f91-967466d8804f
132732024-11-14T09:13:18.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10991 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35274 req_id = 2dca9e78-f652-4819-85ca-57f98d7e4a8f response_code = 201 uri = /metrics/producers
132742024-11-14T09:13:19.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 9e16c628-7a10-47f5-97c0-ea0b07cc4c1e roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
132752024-11-14T09:13:19.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 9e16c628-7a10-47f5-97c0-ea0b07cc4c1e resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
132762024-11-14T09:13:19.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 9e16c628-7a10-47f5-97c0-ea0b07cc4c1e response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
132772024-11-14T09:13:19.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = cdd69beb-fa09-4724-aa23-cc698c162478 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
132782024-11-14T09:13:19.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = cdd69beb-fa09-4724-aa23-cc698c162478 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
132792024-11-14T09:13:19.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = cdd69beb-fa09-4724-aa23-cc698c162478 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
132802024-11-14T09:13:19.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 02167672-0157-47f7-8130-199fd823f549 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132812024-11-14T09:13:19.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 02167672-0157-47f7-8130-199fd823f549 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132822024-11-14T09:13:19.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 02167672-0157-47f7-8130-199fd823f549 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132832024-11-14T09:13:20.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5fb26831-5fbd-4e26-bf70-734652e1eea8 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132842024-11-14T09:13:20.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5fb26831-5fbd-4e26-bf70-734652e1eea8 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132852024-11-14T09:13:20.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5fb26831-5fbd-4e26-bf70-734652e1eea8 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
132862024-11-14T09:13:21.012ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50146
132872024-11-14T09:13:21.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50146 req_id = f0872374-d51b-4e56-b282-4d20161b8ae2 roles = RoleSet { roles: {} } uri = /metrics/producers
132882024-11-14T09:13:21.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50146 req_id = f0872374-d51b-4e56-b282-4d20161b8ae2 resource = Database result = Ok(()) uri = /metrics/producers
132892024-11-14T09:13:21.042ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = c91f550b-068d-4077-a493-b226555a9b58
132902024-11-14T09:13:21.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30191 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50146 req_id = f0872374-d51b-4e56-b282-4d20161b8ae2 response_code = 201 uri = /metrics/producers
132912024-11-14T09:13:21.370ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
132922024-11-14T09:13:21.370ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
132932024-11-14T09:13:21.399ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
132942024-11-14T09:13:21.399ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:57522
132952024-11-14T09:13:21.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57522 req_id = 3f975543-0357-41bb-8983-4cb18d7eaf5e roles = RoleSet { roles: {} } uri = /metrics/producers
132962024-11-14T09:13:21.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57522 req_id = 3f975543-0357-41bb-8983-4cb18d7eaf5e resource = Database result = Ok(()) uri = /metrics/producers
132972024-11-14T09:13:21.417ZINFOnexus: assigned collector to new producer collector_id = 487ff140-60d3-41ba-8767-caa53806d612 file = nexus/src/app/oximeter.rs:76 producer_id = 484a1c50-302f-49ec-9214-2179c2ff7104
132982024-11-14T09:13:21.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17874 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57522 req_id = 3f975543-0357-41bb-8983-4cb18d7eaf5e response_code = 201 uri = /metrics/producers
132992024-11-14T09:13:21.418ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3f975543-0357-41bb-8983-4cb18d7eaf5e", "content-length": "41", "date": "Thu, 14 Nov 2024 09:13:21 GMT"} })
133002024-11-14T09:13:21.419ZDEBGnexus (producer-registration-task): registered with nexus successfully
133012024-11-14T09:13:21.419ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
133022024-11-14T09:13:21.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c3f4529-5d47-49f6-8408-f0aa4bf7ab5e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133032024-11-14T09:13:21.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c3f4529-5d47-49f6-8408-f0aa4bf7ab5e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133042024-11-14T09:13:21.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1c3f4529-5d47-49f6-8408-f0aa4bf7ab5e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133052024-11-14T09:13:22.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 06b28c2e-51a5-4941-b95f-b691e008c490 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133062024-11-14T09:13:22.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 06b28c2e-51a5-4941-b95f-b691e008c490 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133072024-11-14T09:13:22.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 06b28c2e-51a5-4941-b95f-b691e008c490 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133082024-11-14T09:13:23.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f86a0ee7-0b45-4d7c-a48d-5e85aedfc9f2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133092024-11-14T09:13:23.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f86a0ee7-0b45-4d7c-a48d-5e85aedfc9f2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133102024-11-14T09:13:23.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f86a0ee7-0b45-4d7c-a48d-5e85aedfc9f2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133112024-11-14T09:13:24.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e6fd9d1-e79f-4259-9782-22fc77173b6e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133122024-11-14T09:13:24.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e6fd9d1-e79f-4259-9782-22fc77173b6e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133132024-11-14T09:13:24.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2e6fd9d1-e79f-4259-9782-22fc77173b6e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133142024-11-14T09:13:25.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
133152024-11-14T09:13:25.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133162024-11-14T09:13:25.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
133172024-11-14T09:13:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133182024-11-14T09:13:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133192024-11-14T09:13:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133202024-11-14T09:13:25.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133212024-11-14T09:13:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133222024-11-14T09:13:25.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133232024-11-14T09:13:25.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133242024-11-14T09:13:25.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133252024-11-14T09:13:25.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133262024-11-14T09:13:25.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133272024-11-14T09:13:25.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
133282024-11-14T09:13:25.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133292024-11-14T09:13:25.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133302024-11-14T09:13:25.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
133312024-11-14T09:13:25.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.228959ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
133322024-11-14T09:13:25.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133332024-11-14T09:13:25.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133342024-11-14T09:13:25.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.167652ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133352024-11-14T09:13:25.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 281bdbdb-fa37-44e0-8a5a-efe585b273cc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133362024-11-14T09:13:25.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 281bdbdb-fa37-44e0-8a5a-efe585b273cc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133372024-11-14T09:13:25.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 281bdbdb-fa37-44e0-8a5a-efe585b273cc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133382024-11-14T09:13:26.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d627a08-75e8-4284-9612-19819c20faf1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133392024-11-14T09:13:26.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d627a08-75e8-4284-9612-19819c20faf1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133402024-11-14T09:13:26.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7d627a08-75e8-4284-9612-19819c20faf1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133412024-11-14T09:13:27.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 5895ff06-23ae-43a8-b144-bd1ddd5c5130 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
133422024-11-14T09:13:27.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 5895ff06-23ae-43a8-b144-bd1ddd5c5130 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
133432024-11-14T09:13:27.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 5895ff06-23ae-43a8-b144-bd1ddd5c5130 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
133442024-11-14T09:13:27.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d88847d-5e24-4b40-8107-d8d57b7374ab roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133452024-11-14T09:13:27.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d88847d-5e24-4b40-8107-d8d57b7374ab resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133462024-11-14T09:13:27.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5d88847d-5e24-4b40-8107-d8d57b7374ab response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133472024-11-14T09:13:28.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e884e8c6-3379-413e-a1eb-5ddfbc95f1a2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133482024-11-14T09:13:28.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e884e8c6-3379-413e-a1eb-5ddfbc95f1a2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133492024-11-14T09:13:28.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e884e8c6-3379-413e-a1eb-5ddfbc95f1a2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133502024-11-14T09:13:29.054ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = a928b160-ba39-4e1b-a944-7af286dd00b1 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
133512024-11-14T09:13:29.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8852e83a-6f78-4d46-83ab-ab48c2d1035d roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133522024-11-14T09:13:29.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8852e83a-6f78-4d46-83ab-ab48c2d1035d resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133532024-11-14T09:13:29.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8852e83a-6f78-4d46-83ab-ab48c2d1035d response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133542024-11-14T09:13:30.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9e87e09e-844b-42ac-b31f-a6d4c967a908 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133552024-11-14T09:13:30.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9e87e09e-844b-42ac-b31f-a6d4c967a908 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133562024-11-14T09:13:30.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9e87e09e-844b-42ac-b31f-a6d4c967a908 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133572024-11-14T09:13:31.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b684b374-a8ed-4a32-8c1e-d79461882251 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133582024-11-14T09:13:31.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b684b374-a8ed-4a32-8c1e-d79461882251 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133592024-11-14T09:13:31.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b684b374-a8ed-4a32-8c1e-d79461882251 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133602024-11-14T09:13:32.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a641d77a-69a4-44be-b982-f6cf0723f339 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133612024-11-14T09:13:32.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a641d77a-69a4-44be-b982-f6cf0723f339 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133622024-11-14T09:13:32.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a641d77a-69a4-44be-b982-f6cf0723f339 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133632024-11-14T09:13:33.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0ee9f174-9d2d-418a-a5d3-f3deb76aa597 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133642024-11-14T09:13:33.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0ee9f174-9d2d-418a-a5d3-f3deb76aa597 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133652024-11-14T09:13:33.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0ee9f174-9d2d-418a-a5d3-f3deb76aa597 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133662024-11-14T09:13:34.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 2e2fdc5b-7c7f-4439-acff-319ea519d4b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
133672024-11-14T09:13:34.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 2e2fdc5b-7c7f-4439-acff-319ea519d4b4 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
133682024-11-14T09:13:34.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 2e2fdc5b-7c7f-4439-acff-319ea519d4b4 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
133692024-11-14T09:13:34.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 8b06bc38-127e-4298-b47f-8c977ce42a4a roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
133702024-11-14T09:13:34.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 8b06bc38-127e-4298-b47f-8c977ce42a4a resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
133712024-11-14T09:13:34.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 8b06bc38-127e-4298-b47f-8c977ce42a4a response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
133722024-11-14T09:13:34.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d554fa5-0d0e-4296-91b8-4c725c300469 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133732024-11-14T09:13:34.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d554fa5-0d0e-4296-91b8-4c725c300469 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133742024-11-14T09:13:34.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 3d554fa5-0d0e-4296-91b8-4c725c300469 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
133752024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
133762024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133772024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
133782024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
133792024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
133802024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133812024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
133822024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133832024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
133842024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
133852024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
133862024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133872024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
133882024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133892024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
133902024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133912024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
133922024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133932024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
133942024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133952024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
133962024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133972024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
133982024-11-14T09:13:35.535ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
133992024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134002024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
134012024-11-14T09:13:35.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134022024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134032024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134042024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134052024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134062024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134072024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134082024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134092024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134102024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134112024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
134122024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
134132024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134142024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
134152024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
134162024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
134172024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
134182024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
134192024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
134202024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
134212024-11-14T09:13:35.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134222024-11-14T09:13:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
134232024-11-14T09:13:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
134242024-11-14T09:13:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134252024-11-14T09:13:35.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
134262024-11-14T09:13:35.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134272024-11-14T09:13:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134282024-11-14T09:13:35.540ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.272909ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
134292024-11-14T09:13:35.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2023, tv_nsec: 324448395 } })
134302024-11-14T09:13:35.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
134312024-11-14T09:13:35.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134322024-11-14T09:13:35.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134332024-11-14T09:13:35.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134342024-11-14T09:13:35.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2023, tv_nsec: 329015478 } })
134352024-11-14T09:13:35.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
134362024-11-14T09:13:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134372024-11-14T09:13:35.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134382024-11-14T09:13:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134392024-11-14T09:13:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134402024-11-14T09:13:35.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134412024-11-14T09:13:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
134422024-11-14T09:13:35.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134432024-11-14T09:13:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134442024-11-14T09:13:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134452024-11-14T09:13:35.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134462024-11-14T09:13:35.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134472024-11-14T09:13:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134482024-11-14T09:13:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134492024-11-14T09:13:35.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2023, tv_nsec: 337179729 } })
134502024-11-14T09:13:35.555ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
134512024-11-14T09:13:35.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134522024-11-14T09:13:35.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134532024-11-14T09:13:35.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134542024-11-14T09:13:35.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134552024-11-14T09:13:35.578ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134562024-11-14T09:13:35.578ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
134572024-11-14T09:13:35.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134582024-11-14T09:13:35.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
134592024-11-14T09:13:35.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134602024-11-14T09:13:35.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134612024-11-14T09:13:35.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134622024-11-14T09:13:35.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.023204ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
134632024-11-14T09:13:35.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
134642024-11-14T09:13:35.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134652024-11-14T09:13:35.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134662024-11-14T09:13:35.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134672024-11-14T09:13:35.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134682024-11-14T09:13:35.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134692024-11-14T09:13:35.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.434999ms iteration = 32 status = {"errors":[],"records_set_to_done":[]}
134702024-11-14T09:13:35.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
134712024-11-14T09:13:35.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
134722024-11-14T09:13:35.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
134732024-11-14T09:13:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
134742024-11-14T09:13:35.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134752024-11-14T09:13:35.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
134762024-11-14T09:13:35.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134772024-11-14T09:13:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134782024-11-14T09:13:35.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134792024-11-14T09:13:35.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134802024-11-14T09:13:35.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134812024-11-14T09:13:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134822024-11-14T09:13:35.591ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
134832024-11-14T09:13:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
134842024-11-14T09:13:35.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134852024-11-14T09:13:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
134862024-11-14T09:13:35.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134872024-11-14T09:13:35.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.970846ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
134882024-11-14T09:13:35.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.114699ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134892024-11-14T09:13:35.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134902024-11-14T09:13:35.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134912024-11-14T09:13:35.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
134922024-11-14T09:13:35.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.567366ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
134932024-11-14T09:13:35.627ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134942024-11-14T09:13:35.627ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
134952024-11-14T09:13:35.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134962024-11-14T09:13:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134972024-11-14T09:13:35.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134982024-11-14T09:13:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134992024-11-14T09:13:35.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135002024-11-14T09:13:35.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135012024-11-14T09:13:35.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.919491ms iteration = 32 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
135022024-11-14T09:13:35.635ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
135032024-11-14T09:13:35.635ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135042024-11-14T09:13:35.636ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "129d5094-7cfb-450c-b3e4-8611702e6666", "content-length": "26", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135052024-11-14T09:13:35.636ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135062024-11-14T09:13:35.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135072024-11-14T09:13:35.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135082024-11-14T09:13:35.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135092024-11-14T09:13:35.642ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
135102024-11-14T09:13:35.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.197953ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
135112024-11-14T09:13:35.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
135122024-11-14T09:13:35.645ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135132024-11-14T09:13:35.645ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ec9c2c9-77e2-451a-8442-a99378a19141", "content-length": "26", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135142024-11-14T09:13:35.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135152024-11-14T09:13:35.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135162024-11-14T09:13:35.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135172024-11-14T09:13:35.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135182024-11-14T09:13:35.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
135192024-11-14T09:13:35.664ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135202024-11-14T09:13:35.664ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13c8b062-796b-42b8-b714-617bdd848b65", "content-length": "26", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135212024-11-14T09:13:35.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135222024-11-14T09:13:35.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
135232024-11-14T09:13:35.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.679576ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
135242024-11-14T09:13:35.673ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135252024-11-14T09:13:35.673ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
135262024-11-14T09:13:35.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.974106ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
135272024-11-14T09:13:35.676ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.178168ms iteration = 36 status = {"physical_disks_added":0}
135282024-11-14T09:13:35.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135292024-11-14T09:13:35.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
135302024-11-14T09:13:35.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135312024-11-14T09:13:35.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135322024-11-14T09:13:35.682ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.309651ms iteration = 32 status = 0
135332024-11-14T09:13:35.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135342024-11-14T09:13:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135352024-11-14T09:13:35.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135362024-11-14T09:13:35.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
135372024-11-14T09:13:35.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135382024-11-14T09:13:35.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135392024-11-14T09:13:35.769ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 233.721745ms iteration = 32 status = {}
135402024-11-14T09:13:35.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135412024-11-14T09:13:35.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
135422024-11-14T09:13:35.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135432024-11-14T09:13:35.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135442024-11-14T09:13:35.840ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
135452024-11-14T09:13:35.840ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b971d5d-2d35-4b23-9fa1-bd9e17bd5207", "content-length": "2", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135462024-11-14T09:13:35.842ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
135472024-11-14T09:13:35.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
135482024-11-14T09:13:35.854ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
135492024-11-14T09:13:35.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135502024-11-14T09:13:35.854ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2633d02b-007a-48a2-a158-e8ff572ef6e9", "content-length": "372", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135512024-11-14T09:13:35.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135522024-11-14T09:13:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135532024-11-14T09:13:35.856ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 320.288836ms iteration = 32 status = null
135542024-11-14T09:13:35.894ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
135552024-11-14T09:13:35.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
135562024-11-14T09:13:35.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5ea50aa4-4588-40c6-9850-7b9608969c99", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135572024-11-14T09:13:35.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135582024-11-14T09:13:35.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135592024-11-14T09:13:35.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135602024-11-14T09:13:35.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135612024-11-14T09:13:35.897ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
135622024-11-14T09:13:35.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ce8d4b8-9ec3-4a45-8892-95e7b974320c roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
135632024-11-14T09:13:35.898ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38c17dc9-0a6e-4e8d-9867-921ffb695538", "content-length": "691", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135642024-11-14T09:13:35.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ce8d4b8-9ec3-4a45-8892-95e7b974320c resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
135652024-11-14T09:13:35.898ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
135662024-11-14T09:13:35.898ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
135672024-11-14T09:13:35.898ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
135682024-11-14T09:13:35.899ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.429909ms iteration = 33 status = {}
135692024-11-14T09:13:35.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6ce8d4b8-9ec3-4a45-8892-95e7b974320c response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
135702024-11-14T09:13:35.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135712024-11-14T09:13:35.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135722024-11-14T09:13:35.903ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
135732024-11-14T09:13:35.903ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135742024-11-14T09:13:35.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dd4633c4-7c98-48f6-a746-cc6507d05911", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135752024-11-14T09:13:35.911ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 376.010761ms iteration = 34 status = {}
135762024-11-14T09:13:35.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135772024-11-14T09:13:35.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135782024-11-14T09:13:35.916ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
135792024-11-14T09:13:35.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135802024-11-14T09:13:35.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135812024-11-14T09:13:35.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
135822024-11-14T09:13:35.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7d0ea2e-88f1-466d-82b7-a05c5c52bf4c", "content-length": "134", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135832024-11-14T09:13:35.925ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
135842024-11-14T09:13:35.925ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
135852024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
135862024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
135872024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135882024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135892024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135902024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
135912024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135922024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
135932024-11-14T09:13:35.926ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
135942024-11-14T09:13:35.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135952024-11-14T09:13:35.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135962024-11-14T09:13:35.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
135972024-11-14T09:13:35.927ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7228d89c-b59f-4342-bd3d-6237f4468568", "content-length": "2", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
135982024-11-14T09:13:35.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
135992024-11-14T09:13:35.927ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a642bb28-984e-4e44-b462-e6e893dfa086", "content-length": "52", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
136002024-11-14T09:13:35.927ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
136012024-11-14T09:13:35.927ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
136022024-11-14T09:13:36.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2971b545-3717-4749-9df9-c27ef15d75c4", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
136032024-11-14T09:13:36.030ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
136042024-11-14T09:13:36.030ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
136052024-11-14T09:13:36.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d32cf63-2e0c-4b30-ac53-b6f94e16b98b", "content-length": "682", "date": "Thu, 14 Nov 2024 09:13:35 GMT"} })
136062024-11-14T09:13:36.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136072024-11-14T09:13:36.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136082024-11-14T09:13:36.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136092024-11-14T09:13:36.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136102024-11-14T09:13:36.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136112024-11-14T09:13:36.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136122024-11-14T09:13:36.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136132024-11-14T09:13:36.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136142024-11-14T09:13:36.046ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 510.779406ms iteration = 32 status = {}
136152024-11-14T09:13:36.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0e231ab-5eab-4033-ae10-99f4bc8fbb41 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136162024-11-14T09:13:36.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0e231ab-5eab-4033-ae10-99f4bc8fbb41 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136172024-11-14T09:13:36.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d0e231ab-5eab-4033-ae10-99f4bc8fbb41 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136182024-11-14T09:13:37.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1172868-bb0f-48ff-a372-2211c3c58800 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136192024-11-14T09:13:37.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1172868-bb0f-48ff-a372-2211c3c58800 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136202024-11-14T09:13:37.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b1172868-bb0f-48ff-a372-2211c3c58800 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136212024-11-14T09:13:38.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e21d5e01-3370-47e5-94de-5f97292b35ac roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136222024-11-14T09:13:38.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e21d5e01-3370-47e5-94de-5f97292b35ac resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136232024-11-14T09:13:38.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e21d5e01-3370-47e5-94de-5f97292b35ac response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136242024-11-14T09:13:39.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f6a4749-a4e8-4fdc-8756-b6c4805e3453 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136252024-11-14T09:13:39.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f6a4749-a4e8-4fdc-8756-b6c4805e3453 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136262024-11-14T09:13:39.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6f6a4749-a4e8-4fdc-8756-b6c4805e3453 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136272024-11-14T09:13:41.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f23340e7-a719-48e4-8211-0c502934b480 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136282024-11-14T09:13:41.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f23340e7-a719-48e4-8211-0c502934b480 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136292024-11-14T09:13:41.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = f23340e7-a719-48e4-8211-0c502934b480 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136302024-11-14T09:13:42.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bdb70e57-e5dd-4f50-a47e-ee63c578a583 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136312024-11-14T09:13:42.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bdb70e57-e5dd-4f50-a47e-ee63c578a583 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136322024-11-14T09:13:42.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bdb70e57-e5dd-4f50-a47e-ee63c578a583 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136332024-11-14T09:13:43.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1dafdedb-d5a3-4385-aa60-ef3ad69f4864 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136342024-11-14T09:13:43.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1dafdedb-d5a3-4385-aa60-ef3ad69f4864 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136352024-11-14T09:13:43.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1dafdedb-d5a3-4385-aa60-ef3ad69f4864 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136362024-11-14T09:13:44.052ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1636 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 73d08d3d-f129-4de0-b401-3cc262c00fc9 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
136372024-11-14T09:13:44.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6b8c10b1-e952-466a-988c-2ad9b9fb37d2 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136382024-11-14T09:13:44.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6b8c10b1-e952-466a-988c-2ad9b9fb37d2 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136392024-11-14T09:13:44.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6b8c10b1-e952-466a-988c-2ad9b9fb37d2 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136402024-11-14T09:13:45.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1207231c-d09e-4ddd-af58-c0b91baf9cc7 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136412024-11-14T09:13:45.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1207231c-d09e-4ddd-af58-c0b91baf9cc7 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136422024-11-14T09:13:45.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1207231c-d09e-4ddd-af58-c0b91baf9cc7 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136432024-11-14T09:13:45.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
136442024-11-14T09:13:45.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
136452024-11-14T09:13:45.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136462024-11-14T09:13:45.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136472024-11-14T09:13:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136482024-11-14T09:13:45.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136492024-11-14T09:13:45.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136502024-11-14T09:13:45.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136512024-11-14T09:13:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136522024-11-14T09:13:45.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.439962ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136532024-11-14T09:13:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
136542024-11-14T09:13:45.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136552024-11-14T09:13:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136562024-11-14T09:13:45.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136572024-11-14T09:13:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136582024-11-14T09:13:45.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136592024-11-14T09:13:45.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
136602024-11-14T09:13:45.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136612024-11-14T09:13:45.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136622024-11-14T09:13:45.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
136632024-11-14T09:13:45.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.08488ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
136642024-11-14T09:13:46.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 345be431-e9ab-43b2-a13c-af6054d6ed7b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136652024-11-14T09:13:46.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 345be431-e9ab-43b2-a13c-af6054d6ed7b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136662024-11-14T09:13:46.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 345be431-e9ab-43b2-a13c-af6054d6ed7b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136672024-11-14T09:13:47.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4ba82de-6673-402b-b57f-0b21eacbb554 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136682024-11-14T09:13:47.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4ba82de-6673-402b-b57f-0b21eacbb554 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136692024-11-14T09:13:47.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4ba82de-6673-402b-b57f-0b21eacbb554 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136702024-11-14T09:13:48.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af61daff-ebed-427d-9d2d-eca1f350a3c6 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136712024-11-14T09:13:48.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af61daff-ebed-427d-9d2d-eca1f350a3c6 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136722024-11-14T09:13:48.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = af61daff-ebed-427d-9d2d-eca1f350a3c6 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136732024-11-14T09:13:49.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = f84c22ae-2a20-4845-a732-44f17e2aa268 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
136742024-11-14T09:13:49.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = f84c22ae-2a20-4845-a732-44f17e2aa268 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
136752024-11-14T09:13:49.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = f84c22ae-2a20-4845-a732-44f17e2aa268 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
136762024-11-14T09:13:49.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 5698a60f-c2f3-485a-aa97-e9a1cae803b5 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
136772024-11-14T09:13:49.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 5698a60f-c2f3-485a-aa97-e9a1cae803b5 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
136782024-11-14T09:13:49.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 5698a60f-c2f3-485a-aa97-e9a1cae803b5 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
136792024-11-14T09:13:49.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9f054a33-5b83-4f6d-b275-7935d4cd88fb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136802024-11-14T09:13:49.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9f054a33-5b83-4f6d-b275-7935d4cd88fb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136812024-11-14T09:13:49.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9f054a33-5b83-4f6d-b275-7935d4cd88fb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136822024-11-14T09:13:50.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09dcf000-28db-4cee-92b2-7f4a402c87ff roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136832024-11-14T09:13:50.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09dcf000-28db-4cee-92b2-7f4a402c87ff resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136842024-11-14T09:13:50.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 09dcf000-28db-4cee-92b2-7f4a402c87ff response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136852024-11-14T09:13:51.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 075b8383-59bc-4e8a-b940-b9a266b8a090 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136862024-11-14T09:13:51.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 075b8383-59bc-4e8a-b940-b9a266b8a090 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136872024-11-14T09:13:51.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 075b8383-59bc-4e8a-b940-b9a266b8a090 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136882024-11-14T09:13:52.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9d67e7df-10fb-4b52-8e56-0ada41422d19 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136892024-11-14T09:13:52.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9d67e7df-10fb-4b52-8e56-0ada41422d19 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136902024-11-14T09:13:52.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9d67e7df-10fb-4b52-8e56-0ada41422d19 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136912024-11-14T09:13:53.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 958b3247-8cef-42e6-a515-434b2b37e0c0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136922024-11-14T09:13:53.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 958b3247-8cef-42e6-a515-434b2b37e0c0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136932024-11-14T09:13:53.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 958b3247-8cef-42e6-a515-434b2b37e0c0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136942024-11-14T09:13:54.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78ab4aa0-3fc6-4da0-82df-bf9e90a7284e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136952024-11-14T09:13:54.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78ab4aa0-3fc6-4da0-82df-bf9e90a7284e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136962024-11-14T09:13:54.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78ab4aa0-3fc6-4da0-82df-bf9e90a7284e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136972024-11-14T09:13:55.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f148994-709f-4c31-bc21-04eea43390be roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136982024-11-14T09:13:55.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f148994-709f-4c31-bc21-04eea43390be resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
136992024-11-14T09:13:55.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7f148994-709f-4c31-bc21-04eea43390be response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137002024-11-14T09:13:55.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
137012024-11-14T09:13:55.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
137022024-11-14T09:13:55.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137032024-11-14T09:13:55.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137042024-11-14T09:13:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137052024-11-14T09:13:55.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137062024-11-14T09:13:55.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137072024-11-14T09:13:55.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137082024-11-14T09:13:55.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137092024-11-14T09:13:55.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137102024-11-14T09:13:55.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137112024-11-14T09:13:55.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137122024-11-14T09:13:55.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137132024-11-14T09:13:55.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
137142024-11-14T09:13:55.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137152024-11-14T09:13:55.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137162024-11-14T09:13:55.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
137172024-11-14T09:13:55.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.417893ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
137182024-11-14T09:13:55.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137192024-11-14T09:13:55.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137202024-11-14T09:13:55.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.814019ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137212024-11-14T09:13:56.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c3d2e9fe-4042-4a06-933b-e1604fe7d22b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137222024-11-14T09:13:56.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c3d2e9fe-4042-4a06-933b-e1604fe7d22b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137232024-11-14T09:13:56.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c3d2e9fe-4042-4a06-933b-e1604fe7d22b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137242024-11-14T09:13:57.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = dbcb5f3b-40f3-4caf-ab39-027cd5a00586 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
137252024-11-14T09:13:57.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = dbcb5f3b-40f3-4caf-ab39-027cd5a00586 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
137262024-11-14T09:13:57.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = dbcb5f3b-40f3-4caf-ab39-027cd5a00586 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
137272024-11-14T09:13:57.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fa8e6761-0cb7-4485-ba7a-f3a27bfaaddb roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137282024-11-14T09:13:57.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fa8e6761-0cb7-4485-ba7a-f3a27bfaaddb resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137292024-11-14T09:13:57.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = fa8e6761-0cb7-4485-ba7a-f3a27bfaaddb response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137302024-11-14T09:13:58.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6dfe100f-b0d2-40de-82fd-817e7b5ee5cf roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137312024-11-14T09:13:58.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6dfe100f-b0d2-40de-82fd-817e7b5ee5cf resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137322024-11-14T09:13:58.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6dfe100f-b0d2-40de-82fd-817e7b5ee5cf response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137332024-11-14T09:13:59.055ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 00f1ffcd-ab95-4049-98f8-13e8d03e7841 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
137342024-11-14T09:13:59.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2a373738-5d79-4ea4-816f-228e3f790752 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137352024-11-14T09:13:59.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2a373738-5d79-4ea4-816f-228e3f790752 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137362024-11-14T09:13:59.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2a373738-5d79-4ea4-816f-228e3f790752 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137372024-11-14T09:14:00.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bbd8802-9b05-41b2-a888-2109d27789c0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137382024-11-14T09:14:00.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bbd8802-9b05-41b2-a888-2109d27789c0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137392024-11-14T09:14:00.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 7bbd8802-9b05-41b2-a888-2109d27789c0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137402024-11-14T09:14:01.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1014cc1b-f131-490f-8366-e3b548a50269 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137412024-11-14T09:14:01.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1014cc1b-f131-490f-8366-e3b548a50269 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137422024-11-14T09:14:01.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1014cc1b-f131-490f-8366-e3b548a50269 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137432024-11-14T09:14:02.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e0092f5-eaf4-4148-be68-cd7f4ccebe99 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137442024-11-14T09:14:02.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e0092f5-eaf4-4148-be68-cd7f4ccebe99 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137452024-11-14T09:14:02.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4e0092f5-eaf4-4148-be68-cd7f4ccebe99 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137462024-11-14T09:14:03.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e80fc9ed-2719-4433-b384-d8a9b50b7b5b roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137472024-11-14T09:14:03.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e80fc9ed-2719-4433-b384-d8a9b50b7b5b resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137482024-11-14T09:14:03.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = e80fc9ed-2719-4433-b384-d8a9b50b7b5b response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137492024-11-14T09:14:04.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 3a4baf88-6a40-48ab-bf05-5444dd092217 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
137502024-11-14T09:14:04.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 3a4baf88-6a40-48ab-bf05-5444dd092217 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
137512024-11-14T09:14:04.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 3a4baf88-6a40-48ab-bf05-5444dd092217 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
137522024-11-14T09:14:04.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 9c57c1f4-edca-4343-9ff2-11fd61cf56ed roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
137532024-11-14T09:14:04.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 9c57c1f4-edca-4343-9ff2-11fd61cf56ed resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
137542024-11-14T09:14:04.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 9c57c1f4-edca-4343-9ff2-11fd61cf56ed response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
137552024-11-14T09:14:04.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 06373fc4-a90b-4e38-a565-9dd1e2f786cc roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137562024-11-14T09:14:04.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 06373fc4-a90b-4e38-a565-9dd1e2f786cc resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137572024-11-14T09:14:04.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 06373fc4-a90b-4e38-a565-9dd1e2f786cc response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
137582024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 97 reason = Timeout
137592024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137602024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 33 reason = Timeout
137612024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 19 reason = Timeout
137622024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 33 reason = Timeout
137632024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 97 reason = Timeout
137642024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 37 reason = Timeout
137652024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137662024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137672024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 17 reason = Timeout
137682024-11-14T09:14:05.536ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
137692024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137702024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 18 reason = Timeout
137712024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
137722024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
137732024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 33 reason = Timeout
137742024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137752024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
137762024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 33 reason = Timeout
137772024-11-14T09:14:05.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
137782024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 33 reason = Timeout
137792024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
137802024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 33 reason = Timeout
137812024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137822024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 18 reason = Timeout
137832024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 17 reason = Timeout
137842024-11-14T09:14:05.537ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 09:04:05.536988813 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
137852024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
137862024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 34 reason = Timeout
137872024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137882024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 33 reason = Timeout
137892024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
137902024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 18 reason = Timeout
137912024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
137922024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137932024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 18 reason = Timeout
137942024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 19 reason = Timeout
137952024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 33 reason = Timeout
137962024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
137972024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137982024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 18 reason = Timeout
137992024-11-14T09:14:05.537ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ba765988-384f-4139-bf08-672b284949f0
138002024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 35 reason = Timeout
138012024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.901\u{b5}s iteration = 18 status = {"enabled":false,"target_id":"ba765988-384f-4139-bf08-672b284949f0"}
138022024-11-14T09:14:05.537ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
138032024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 18 reason = Timeout
138042024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138052024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 17 reason = Timeout
138062024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
138072024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
138082024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 17 reason = Timeout
138092024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 33 reason = Timeout
138102024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
138112024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
138122024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 33 reason = Timeout
138132024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
138142024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 33 reason = Timeout
138152024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
138162024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 33 reason = Timeout
138172024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
138182024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 17 reason = Timeout
138192024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
138202024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138212024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138222024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
138232024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
138242024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
138252024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138262024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
138272024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138282024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138292024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138302024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
138312024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138322024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138332024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138342024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138352024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
138362024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
138372024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
138382024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
138392024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
138402024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
138412024-11-14T09:14:05.537ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0fbd02e-9643-47c5-9261-dd03abc268a8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef32bdd5-939a-4ab0-a70a-6f004e97691b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2053, tv_nsec: 319469315 } })
138422024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138432024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
138442024-11-14T09:14:05.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
138452024-11-14T09:14:05.537ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f4dacff-88ec-4392-8377-4682964053f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7876d8e5-f244-4867-9c35-6d9384606bc9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0601c15-cf44-46d3-b9aa-36324427c5b0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2053, tv_nsec: 319494935 } })
138462024-11-14T09:14:05.538ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
138472024-11-14T09:14:05.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.25519ms iteration = 18 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
138482024-11-14T09:14:05.538ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
138492024-11-14T09:14:05.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.479324ms iteration = 18 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
138502024-11-14T09:14:05.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138512024-11-14T09:14:05.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138522024-11-14T09:14:05.540ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.119856ms iteration = 33 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
138532024-11-14T09:14:05.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138542024-11-14T09:14:05.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2053, tv_nsec: 322724207 } })
138552024-11-14T09:14:05.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
138562024-11-14T09:14:05.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138572024-11-14T09:14:05.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
138582024-11-14T09:14:05.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
138592024-11-14T09:14:05.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138602024-11-14T09:14:05.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2053, tv_nsec: 324386824 } })
138612024-11-14T09:14:05.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
138622024-11-14T09:14:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
138632024-11-14T09:14:05.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
138642024-11-14T09:14:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
138652024-11-14T09:14:05.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
138662024-11-14T09:14:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
138672024-11-14T09:14:05.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
138682024-11-14T09:14:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138692024-11-14T09:14:05.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138702024-11-14T09:14:05.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138712024-11-14T09:14:05.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138722024-11-14T09:14:05.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138732024-11-14T09:14:05.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138742024-11-14T09:14:05.548ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 09:04:05.536988813 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
138752024-11-14T09:14:05.548ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.336151ms iteration = 17 status = {"expiration":"2024-11-14T09:04:05.536988813Z","pruned":[]}
138762024-11-14T09:14:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
138772024-11-14T09:14:05.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138782024-11-14T09:14:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138792024-11-14T09:14:05.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
138802024-11-14T09:14:05.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138812024-11-14T09:14:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
138822024-11-14T09:14:05.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138832024-11-14T09:14:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
138842024-11-14T09:14:05.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138852024-11-14T09:14:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138862024-11-14T09:14:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138872024-11-14T09:14:05.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138882024-11-14T09:14:05.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138892024-11-14T09:14:05.558ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
138902024-11-14T09:14:05.558ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
138912024-11-14T09:14:05.558ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.063389ms iteration = 17 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
138922024-11-14T09:14:05.558ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.484935ms iteration = 17 status = {"errors":[],"found_port_ok":[]}
138932024-11-14T09:14:05.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138942024-11-14T09:14:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138952024-11-14T09:14:05.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138962024-11-14T09:14:05.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-65d2236a-3110-4d84-aa25-77e21779db87.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2053, tv_nsec: 345856819 } })
138972024-11-14T09:14:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138982024-11-14T09:14:05.564ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
138992024-11-14T09:14:05.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139002024-11-14T09:14:05.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139012024-11-14T09:14:05.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.777159ms iteration = 33 status = {"errors":[],"garbage_collect_requested":[]}
139022024-11-14T09:14:05.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139032024-11-14T09:14:05.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.496971ms iteration = 33 status = {"errors":[],"records_set_to_done":[]}
139042024-11-14T09:14:05.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.284811ms iteration = 97 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139052024-11-14T09:14:05.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
139062024-11-14T09:14:05.610ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
139072024-11-14T09:14:05.610ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
139082024-11-14T09:14:05.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
139092024-11-14T09:14:05.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
139102024-11-14T09:14:05.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139112024-11-14T09:14:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139122024-11-14T09:14:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
139132024-11-14T09:14:05.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139142024-11-14T09:14:05.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139152024-11-14T09:14:05.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139162024-11-14T09:14:05.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139172024-11-14T09:14:05.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
139182024-11-14T09:14:05.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139192024-11-14T09:14:05.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139202024-11-14T09:14:05.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139212024-11-14T09:14:05.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.869121ms iteration = 33 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
139222024-11-14T09:14:05.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
139232024-11-14T09:14:05.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139242024-11-14T09:14:05.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139252024-11-14T09:14:05.616ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
139262024-11-14T09:14:05.616ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
139272024-11-14T09:14:05.616ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.050096ms iteration = 17 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
139282024-11-14T09:14:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
139292024-11-14T09:14:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
139302024-11-14T09:14:05.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139312024-11-14T09:14:05.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139322024-11-14T09:14:05.621ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
139332024-11-14T09:14:05.621ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.762832ms iteration = 33 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
139342024-11-14T09:14:05.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139352024-11-14T09:14:05.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d92daf2b-78ae-49d6-a6d5-c189e6d2ccc5 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
139362024-11-14T09:14:05.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139372024-11-14T09:14:05.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d92daf2b-78ae-49d6-a6d5-c189e6d2ccc5 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
139382024-11-14T09:14:05.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139392024-11-14T09:14:05.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d92daf2b-78ae-49d6-a6d5-c189e6d2ccc5 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
139402024-11-14T09:14:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
139412024-11-14T09:14:05.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139422024-11-14T09:14:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139432024-11-14T09:14:05.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139442024-11-14T09:14:05.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139452024-11-14T09:14:05.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139462024-11-14T09:14:05.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139472024-11-14T09:14:05.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139482024-11-14T09:14:05.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139492024-11-14T09:14:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
139502024-11-14T09:14:05.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139512024-11-14T09:14:05.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139522024-11-14T09:14:05.650ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
139532024-11-14T09:14:05.650ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
139542024-11-14T09:14:05.650ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
139552024-11-14T09:14:05.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139562024-11-14T09:14:05.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139572024-11-14T09:14:05.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139582024-11-14T09:14:05.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 65d2236a-3110-4d84-aa25-77e21779db87, lookup_type: ById(65d2236a-3110-4d84-aa25-77e21779db87) } result = Ok(())
139592024-11-14T09:14:05.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139602024-11-14T09:14:05.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139612024-11-14T09:14:05.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
139622024-11-14T09:14:05.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
139632024-11-14T09:14:05.654ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.452167ms iteration = 33 status = 0
139642024-11-14T09:14:05.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139652024-11-14T09:14:05.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
139662024-11-14T09:14:05.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139672024-11-14T09:14:05.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139682024-11-14T09:14:05.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139692024-11-14T09:14:05.657ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
139702024-11-14T09:14:05.657ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
139712024-11-14T09:14:05.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
139722024-11-14T09:14:05.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139732024-11-14T09:14:05.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.395088ms iteration = 33 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
139742024-11-14T09:14:05.662ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
139752024-11-14T09:14:05.662ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.7609ms iteration = 97 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
139762024-11-14T09:14:05.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139772024-11-14T09:14:05.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
139782024-11-14T09:14:05.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139792024-11-14T09:14:05.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139802024-11-14T09:14:05.674ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
139812024-11-14T09:14:05.674ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
139822024-11-14T09:14:05.674ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
139832024-11-14T09:14:05.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
139842024-11-14T09:14:05.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
139852024-11-14T09:14:05.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139862024-11-14T09:14:05.677ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139872024-11-14T09:14:05.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139882024-11-14T09:14:05.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
139892024-11-14T09:14:05.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
139902024-11-14T09:14:05.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
139912024-11-14T09:14:05.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139922024-11-14T09:14:05.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
139932024-11-14T09:14:05.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139942024-11-14T09:14:05.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139952024-11-14T09:14:05.686ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
139962024-11-14T09:14:05.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139972024-11-14T09:14:05.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139982024-11-14T09:14:05.695ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
139992024-11-14T09:14:05.700ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
140002024-11-14T09:14:05.700ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140012024-11-14T09:14:05.701ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a29b0194-b526-4675-b3e8-79d53df62a93", "content-length": "26", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
140022024-11-14T09:14:05.701ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140032024-11-14T09:14:05.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 165.062023ms iteration = 33 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
140042024-11-14T09:14:05.702ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
140052024-11-14T09:14:05.702ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 0 version = 2
140062024-11-14T09:14:05.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140072024-11-14T09:14:05.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd zone_address = fd00:1122:3344:101::2
140082024-11-14T09:14:05.702ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140092024-11-14T09:14:05.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140102024-11-14T09:14:05.703ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac37155f-1a30-4c87-9cac-80558e856752", "content-length": "26", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
140112024-11-14T09:14:05.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140122024-11-14T09:14:05.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140132024-11-14T09:14:05.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140142024-11-14T09:14:05.704ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140152024-11-14T09:14:05.704ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
140162024-11-14T09:14:05.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.652644ms iteration = 33 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
140172024-11-14T09:14:05.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
140182024-11-14T09:14:05.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
140192024-11-14T09:14:05.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140202024-11-14T09:14:05.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
140212024-11-14T09:14:05.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140222024-11-14T09:14:05.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140232024-11-14T09:14:05.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c42be1a-92dd-4f91-bca4-1ca91b1923bd", "content-length": "26", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
140242024-11-14T09:14:05.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140252024-11-14T09:14:05.709ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = e4e55475-3e7c-4edc-9524-6ecc451a4365 dns_zone_name = oxide.test found_so_far = 1 version = 2
140262024-11-14T09:14:05.709ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
140272024-11-14T09:14:05.709ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 08:58:19.264785 UTC dns_group = external generation = 2
140282024-11-14T09:14:05.709ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 172.646094ms iteration = 18 status = {"generation":2}
140292024-11-14T09:14:05.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140302024-11-14T09:14:05.719ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
140312024-11-14T09:14:05.719ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
140322024-11-14T09:14:05.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
140332024-11-14T09:14:05.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
140342024-11-14T09:14:05.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140352024-11-14T09:14:05.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
140362024-11-14T09:14:05.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
140372024-11-14T09:14:05.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
140382024-11-14T09:14:05.727ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 374f4088-36de-48ec-8314-dfa63cdeef2a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
140392024-11-14T09:14:05.727ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
140402024-11-14T09:14:05.727ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 08:58:18.295649 UTC dns_group = internal generation = 1
140412024-11-14T09:14:05.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 190.057884ms iteration = 18 status = {"generation":1}
140422024-11-14T09:14:05.731ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T08:58:02.943094Z, time_modified: 2024-11-14T08:58:02.943094Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, db_silo: Silo { identity: SiloIdentity { id: 4528c2fc-966b-410e-bee5-f98d6efd8ad1, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T08:58:19.176269Z, time_modified: 2024-11-14T08:58:19.176269Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd" }] }) }
140432024-11-14T09:14:05.731ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 194.614327ms iteration = 18 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]}},"default_endpoint":{"silo_id":"4528c2fc-966b-410e-bee5-f98d6efd8ad1","tls_certs":["da07885ef5dc1470b65f08b21cc67e53274897d60a54f248a8b23ebfdf14b6fd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
140442024-11-14T09:14:05.738ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.982125ms iteration = 37 status = {"physical_disks_added":0}
140452024-11-14T09:14:05.756ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
140462024-11-14T09:14:05.756ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 219.293453ms iteration = 17 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
140472024-11-14T09:14:05.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140482024-11-14T09:14:05.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140492024-11-14T09:14:05.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140502024-11-14T09:14:05.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
140512024-11-14T09:14:05.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140522024-11-14T09:14:05.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140532024-11-14T09:14:05.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140542024-11-14T09:14:05.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
140552024-11-14T09:14:05.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140562024-11-14T09:14:05.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140572024-11-14T09:14:05.856ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
140582024-11-14T09:14:05.856ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "52f52a8f-8cc8-4ef8-adb2-aa50e3531c7e", "content-length": "2", "date": "Thu, 14 Nov 2024 09:14:04 GMT"} })
140592024-11-14T09:14:05.857ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
140602024-11-14T09:14:05.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
140612024-11-14T09:14:05.859ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
140622024-11-14T09:14:05.859ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6dd80c14-bd2f-440d-a8cd-ab791af7021d", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
140632024-11-14T09:14:05.859ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
140642024-11-14T09:14:05.862ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5ddb604d-7736-45af-b1d5-718ca82cbd5d", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
140652024-11-14T09:14:05.862ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
140662024-11-14T09:14:05.863ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
140672024-11-14T09:14:05.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 327.185517ms iteration = 19 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
140682024-11-14T09:14:05.878ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.874532ms iteration = 33 status = {}
140692024-11-14T09:14:05.894ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
140702024-11-14T09:14:05.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
140712024-11-14T09:14:05.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f97e56e-193f-4509-8d41-fc0969555ea2", "content-length": "372", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
140722024-11-14T09:14:05.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140732024-11-14T09:14:05.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140742024-11-14T09:14:05.896ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 359.662428ms iteration = 33 status = null
140752024-11-14T09:14:05.919ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
140762024-11-14T09:14:05.919ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
140772024-11-14T09:14:05.919ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb8805b6-fca9-48da-88e1-64c35f4d61e0", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
140782024-11-14T09:14:05.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140792024-11-14T09:14:05.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140802024-11-14T09:14:05.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140812024-11-14T09:14:05.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140822024-11-14T09:14:05.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140832024-11-14T09:14:05.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140842024-11-14T09:14:05.929ZINFOnexus (BackgroundTasks): VPC route manager sled 65d2236a-3110-4d84-aa25-77e21779db87 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
140852024-11-14T09:14:05.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
140862024-11-14T09:14:05.929ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8c4b7c18-aa35-4374-b873-a39ba9f26d72", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
140872024-11-14T09:14:05.931ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.405886ms iteration = 35 status = {}
140882024-11-14T09:14:05.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
140892024-11-14T09:14:06.044ZDEBGnexus (BackgroundTasks): client request SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
140902024-11-14T09:14:06.085ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
140912024-11-14T09:14:06.086ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bb2aa7a1-c878-4b77-8cd2-289809a0293f", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140922024-11-14T09:14:06.086ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140932024-11-14T09:14:06.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0bd8e4aa-c9e1-4e91-afbc-7fd87ad0e2d2", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140942024-11-14T09:14:06.087ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140952024-11-14T09:14:06.089ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0912483a-0e83-4dd7-93ab-13e09e322c54", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140962024-11-14T09:14:06.089ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140972024-11-14T09:14:06.091ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
140982024-11-14T09:14:06.091ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.63121ms iteration = 19 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
140992024-11-14T09:14:06.101ZDEBGnexus (BackgroundTasks): client response SledAgent = 65d2236a-3110-4d84-aa25-77e21779db87 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "646cd77c-16eb-4912-ba54-fff673c5d926", "content-length": "691", "date": "Thu, 14 Nov 2024 09:14:06 GMT"} })
141002024-11-14T09:14:06.101ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
141012024-11-14T09:14:06.101ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
141022024-11-14T09:14:06.101ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
141032024-11-14T09:14:06.103ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 566.314578ms iteration = 34 status = {}
141042024-11-14T09:14:06.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141052024-11-14T09:14:06.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141062024-11-14T09:14:06.124ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 91d2fc07-dd6e-4ff9-9d22-f05239ec1266, rack_id: f4ca1ebb-1dae-4dba-966b-c23460ac15fd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dad8c394-7683-4884-bb91-70e7d71711e7) } rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
141072024-11-14T09:14:06.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141082024-11-14T09:14:06.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141092024-11-14T09:14:06.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
141102024-11-14T09:14:06.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "414888dc-e8bf-4982-a2f5-772257a7b74e", "content-length": "134", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
141112024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
141122024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dad8c394-7683-4884-bb91-70e7d71711e7
141132024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
141142024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
141152024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141162024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141172024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141182024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141192024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141202024-11-14T09:14:06.135ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141212024-11-14T09:14:06.136ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd
141222024-11-14T09:14:06.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141232024-11-14T09:14:06.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141242024-11-14T09:14:06.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
141252024-11-14T09:14:06.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d928df4-349a-42b8-a868-a6a439ee13de", "content-length": "2", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
141262024-11-14T09:14:06.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
141272024-11-14T09:14:06.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d47295a3-4523-40f1-8eb5-c7c45c067569", "content-length": "52", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
141282024-11-14T09:14:06.138ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch_location = Switch0
141292024-11-14T09:14:06.138ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
141302024-11-14T09:14:06.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a9b096ad-3c4f-4f65-9f82-5a369afadeae", "date": "Thu, 14 Nov 2024 09:14:05 GMT"} })
141312024-11-14T09:14:06.305ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd switch = Switch0
141322024-11-14T09:14:06.305ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
141332024-11-14T09:14:06.305ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f4ca1ebb-1dae-4dba-966b-c23460ac15fd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d63cbbd-2fe7-4c9e-9a64-01f6f807e3d5", "content-length": "682", "date": "Thu, 14 Nov 2024 09:14:06 GMT"} })
141342024-11-14T09:14:06.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141352024-11-14T09:14:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141362024-11-14T09:14:06.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141372024-11-14T09:14:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141382024-11-14T09:14:06.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141392024-11-14T09:14:06.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141402024-11-14T09:14:06.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141412024-11-14T09:14:06.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141422024-11-14T09:14:06.322ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 785.193944ms iteration = 33 status = {}
141432024-11-14T09:14:06.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c05b9216-f06a-4666-8a53-36f0385b8a73 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141442024-11-14T09:14:06.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c05b9216-f06a-4666-8a53-36f0385b8a73 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141452024-11-14T09:14:06.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c05b9216-f06a-4666-8a53-36f0385b8a73 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141462024-11-14T09:14:07.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8678f0d7-0266-4814-9837-61d9f3abbc6f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141472024-11-14T09:14:07.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8678f0d7-0266-4814-9837-61d9f3abbc6f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141482024-11-14T09:14:07.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 8678f0d7-0266-4814-9837-61d9f3abbc6f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141492024-11-14T09:14:08.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a5fd403-a4d1-4d91-8a87-079acc540417 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141502024-11-14T09:14:08.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a5fd403-a4d1-4d91-8a87-079acc540417 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141512024-11-14T09:14:08.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 6a5fd403-a4d1-4d91-8a87-079acc540417 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141522024-11-14T09:14:09.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b972bf5-bae5-40da-bbc8-8f6972dd320f roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141532024-11-14T09:14:09.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b972bf5-bae5-40da-bbc8-8f6972dd320f resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141542024-11-14T09:14:09.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 9b972bf5-bae5-40da-bbc8-8f6972dd320f response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141552024-11-14T09:14:10.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd33d94c-0014-4a23-9862-c82b80b201d0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141562024-11-14T09:14:10.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd33d94c-0014-4a23-9862-c82b80b201d0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141572024-11-14T09:14:10.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = bd33d94c-0014-4a23-9862-c82b80b201d0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141582024-11-14T09:14:11.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4068707-c5d1-4a58-9a28-f62a526e1f07 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141592024-11-14T09:14:11.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4068707-c5d1-4a58-9a28-f62a526e1f07 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141602024-11-14T09:14:11.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d4068707-c5d1-4a58-9a28-f62a526e1f07 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141612024-11-14T09:14:12.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78df6c70-aa11-4e84-8e91-4a9e30663d0e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141622024-11-14T09:14:12.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78df6c70-aa11-4e84-8e91-4a9e30663d0e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141632024-11-14T09:14:12.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 78df6c70-aa11-4e84-8e91-4a9e30663d0e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141642024-11-14T09:14:13.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a567ccc4-9086-48f5-bcac-c8cbc30936a4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141652024-11-14T09:14:13.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a567ccc4-9086-48f5-bcac-c8cbc30936a4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141662024-11-14T09:14:13.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = a567ccc4-9086-48f5-bcac-c8cbc30936a4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141672024-11-14T09:14:14.054ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1332 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = dd7e9fcb-1980-43ed-ab46-c127263f192f response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
141682024-11-14T09:14:14.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5353f8c8-e989-46b7-a703-fb1c3d418ac0 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141692024-11-14T09:14:14.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5353f8c8-e989-46b7-a703-fb1c3d418ac0 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141702024-11-14T09:14:14.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5353f8c8-e989-46b7-a703-fb1c3d418ac0 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141712024-11-14T09:14:15.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 98 reason = Timeout
141722024-11-14T09:14:15.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 98 reason = Timeout
141732024-11-14T09:14:15.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141742024-11-14T09:14:15.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141752024-11-14T09:14:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141762024-11-14T09:14:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141772024-11-14T09:14:15.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141782024-11-14T09:14:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141792024-11-14T09:14:15.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141802024-11-14T09:14:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141812024-11-14T09:14:15.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141822024-11-14T09:14:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141832024-11-14T09:14:15.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141842024-11-14T09:14:15.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141852024-11-14T09:14:15.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141862024-11-14T09:14:15.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
141872024-11-14T09:14:15.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141882024-11-14T09:14:15.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141892024-11-14T09:14:15.587ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
141902024-11-14T09:14:15.587ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.396835ms iteration = 98 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
141912024-11-14T09:14:15.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.008009ms iteration = 98 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
141922024-11-14T09:14:15.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ae2e773e-fe4e-495f-9323-57d276224683 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141932024-11-14T09:14:15.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ae2e773e-fe4e-495f-9323-57d276224683 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141942024-11-14T09:14:15.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ae2e773e-fe4e-495f-9323-57d276224683 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141952024-11-14T09:14:16.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 967e8a67-740d-4ad9-81bd-10a1671f4339 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141962024-11-14T09:14:16.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 967e8a67-740d-4ad9-81bd-10a1671f4339 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141972024-11-14T09:14:16.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 967e8a67-740d-4ad9-81bd-10a1671f4339 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141982024-11-14T09:14:17.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ddf69f2d-cbfc-46d3-8d4a-808b2c13f9ab roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
141992024-11-14T09:14:17.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ddf69f2d-cbfc-46d3-8d4a-808b2c13f9ab resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142002024-11-14T09:14:17.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ddf69f2d-cbfc-46d3-8d4a-808b2c13f9ab response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142012024-11-14T09:14:18.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca56ffb6-1df7-4eec-a44c-cfbaa4aa3c92 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142022024-11-14T09:14:18.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca56ffb6-1df7-4eec-a44c-cfbaa4aa3c92 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142032024-11-14T09:14:18.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = ca56ffb6-1df7-4eec-a44c-cfbaa4aa3c92 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142042024-11-14T09:14:19.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 83310340-1ebc-4398-8f7a-79c3ad8401d6 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
142052024-11-14T09:14:19.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 83310340-1ebc-4398-8f7a-79c3ad8401d6 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
142062024-11-14T09:14:19.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 83310340-1ebc-4398-8f7a-79c3ad8401d6 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?sort_by=id_ascending
142072024-11-14T09:14:19.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 0c4b3f74-6470-4b8f-95e3-490fcaba32c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
142082024-11-14T09:14:19.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 0c4b3f74-6470-4b8f-95e3-490fcaba32c3 resource = Database result = Ok(()) uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
142092024-11-14T09:14:19.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63126 req_id = 0c4b3f74-6470-4b8f-95e3-490fcaba32c3 response_code = 200 uri = /metrics/collectors/487ff140-60d3-41ba-8767-caa53806d612/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkM2RkNDAzNi02ODM5LTQ4ZDYtOGYzNi1lNjQyZDliM2U2YzAifX0%3D
142102024-11-14T09:14:19.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0afe483a-2519-4de0-a29e-471287d7a0c9 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142112024-11-14T09:14:19.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0afe483a-2519-4de0-a29e-471287d7a0c9 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142122024-11-14T09:14:19.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 0afe483a-2519-4de0-a29e-471287d7a0c9 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142132024-11-14T09:14:21.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b4a0e16d-009a-41b3-bc97-8e9c1c39fe05 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142142024-11-14T09:14:21.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b4a0e16d-009a-41b3-bc97-8e9c1c39fe05 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142152024-11-14T09:14:21.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = b4a0e16d-009a-41b3-bc97-8e9c1c39fe05 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142162024-11-14T09:14:22.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8fbdb09-c82a-4c0a-b815-650352c9cf25 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142172024-11-14T09:14:22.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8fbdb09-c82a-4c0a-b815-650352c9cf25 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142182024-11-14T09:14:22.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = c8fbdb09-c82a-4c0a-b815-650352c9cf25 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142192024-11-14T09:14:23.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 46b76008-96da-4f29-b1c5-48e796ab82f4 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142202024-11-14T09:14:23.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 46b76008-96da-4f29-b1c5-48e796ab82f4 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142212024-11-14T09:14:23.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 46b76008-96da-4f29-b1c5-48e796ab82f4 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142222024-11-14T09:14:24.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4c0d71d0-a120-479f-9179-39eb2b010f18 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142232024-11-14T09:14:24.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4c0d71d0-a120-479f-9179-39eb2b010f18 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142242024-11-14T09:14:24.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 4c0d71d0-a120-479f-9179-39eb2b010f18 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142252024-11-14T09:14:25.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d45a2cde-7fea-48fe-adde-243349363c81 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142262024-11-14T09:14:25.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d45a2cde-7fea-48fe-adde-243349363c81 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142272024-11-14T09:14:25.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d45a2cde-7fea-48fe-adde-243349363c81 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142282024-11-14T09:14:25.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 99 reason = Timeout
142292024-11-14T09:14:25.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 99 reason = Timeout
142302024-11-14T09:14:25.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142312024-11-14T09:14:25.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142322024-11-14T09:14:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142332024-11-14T09:14:25.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142342024-11-14T09:14:25.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142352024-11-14T09:14:25.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142362024-11-14T09:14:25.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142372024-11-14T09:14:25.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.184253ms iteration = 99 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142382024-11-14T09:14:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142392024-11-14T09:14:25.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142402024-11-14T09:14:25.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142412024-11-14T09:14:25.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142422024-11-14T09:14:25.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142432024-11-14T09:14:25.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142442024-11-14T09:14:25.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ba765988-384f-4139-bf08-672b284949f0, lookup_type: ById(ba765988-384f-4139-bf08-672b284949f0) } result = Ok(())
142452024-11-14T09:14:25.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142462024-11-14T09:14:25.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142472024-11-14T09:14:25.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ba765988-384f-4139-bf08-672b284949f0 original_time_created = 2024-11-14 08:57:54.143019 UTC target_id = ba765988-384f-4139-bf08-672b284949f0 time_created = 2024-11-14 08:57:54.143019 UTC
142482024-11-14T09:14:25.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.089121ms iteration = 99 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ba765988-384f-4139-bf08-672b284949f0","time_created":"2024-11-14T08:57:54.143019Z"}
142492024-11-14T09:14:26.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c60d3ca-b546-4c87-99e9-2a3e819d7d6e roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142502024-11-14T09:14:26.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c60d3ca-b546-4c87-99e9-2a3e819d7d6e resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142512024-11-14T09:14:26.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 5c60d3ca-b546-4c87-99e9-2a3e819d7d6e response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142522024-11-14T09:14:27.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 182aaf3f-3330-4d00-ae1c-46c3043cc0ee roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142532024-11-14T09:14:27.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 182aaf3f-3330-4d00-ae1c-46c3043cc0ee resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142542024-11-14T09:14:27.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 182aaf3f-3330-4d00-ae1c-46c3043cc0ee response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142552024-11-14T09:14:27.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 41400a36-e9bd-44e4-bd6b-e9fcfefbc6a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
142562024-11-14T09:14:27.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 41400a36-e9bd-44e4-bd6b-e9fcfefbc6a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
142572024-11-14T09:14:27.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43532 req_id = 41400a36-e9bd-44e4-bd6b-e9fcfefbc6a1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
142582024-11-14T09:14:28.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ea7ae5f-9842-48e8-b0ce-5b11143dc628 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142592024-11-14T09:14:28.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ea7ae5f-9842-48e8-b0ce-5b11143dc628 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142602024-11-14T09:14:28.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 2ea7ae5f-9842-48e8-b0ce-5b11143dc628 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142612024-11-14T09:14:29.052ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1438 local_addr = [fd00:1122:3344:101::c]:45655 method = GET remote_addr = [fd00:1122:3344:101::d]:42152 req_id = 40bac70e-7b6d-4853-9bf3-68cfff4ef438 response_code = 200 uri = /484a1c50-302f-49ec-9214-2179c2ff7104
142622024-11-14T09:14:29.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1e3aa737-cdec-44a2-9d57-bb68ae762fe1 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142632024-11-14T09:14:29.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1e3aa737-cdec-44a2-9d57-bb68ae762fe1 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142642024-11-14T09:14:29.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = 1e3aa737-cdec-44a2-9d57-bb68ae762fe1 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142652024-11-14T09:14:30.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d3a58710-c894-47e2-a9ef-cf04fb431b99 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142662024-11-14T09:14:30.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d3a58710-c894-47e2-a9ef-cf04fb431b99 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142672024-11-14T09:14:30.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d3a58710-c894-47e2-a9ef-cf04fb431b99 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142682024-11-14T09:14:31.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d62ea5a6-f6a0-49d4-8500-c70e208dd319 roles = RoleSet { roles: {} } uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142692024-11-14T09:14:31.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d62ea5a6-f6a0-49d4-8500-c70e208dd319 resource = Database result = Ok(()) uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87
142702024-11-14T09:14:31.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52849 req_id = d62ea5a6-f6a0-49d4-8500-c70e208dd319 response_code = 200 uri = /probes/65d2236a-3110-4d84-aa25-77e21779db87