Max level shown:
12025-01-02T23:45:02.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 55e7f123-9d6d-4cfa-b4ec-60ecfa12f5a1 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
22025-01-02T23:45:02.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 55e7f123-9d6d-4cfa-b4ec-60ecfa12f5a1 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
32025-01-02T23:45:02.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 55e7f123-9d6d-4cfa-b4ec-60ecfa12f5a1 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
42025-01-02T23:45:03.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bdb30f56-f652-47a9-8d9a-99bfabc582a8 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
52025-01-02T23:45:03.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bdb30f56-f652-47a9-8d9a-99bfabc582a8 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
62025-01-02T23:45:03.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bdb30f56-f652-47a9-8d9a-99bfabc582a8 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
72025-01-02T23:45:03.719ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = cffb38ab-3746-4cc5-af64-aab39fc497bd response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
82025-01-02T23:45:04.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ed7d62ce-4351-4da4-ab94-13782d6db196 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
92025-01-02T23:45:04.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ed7d62ce-4351-4da4-ab94-13782d6db196 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
102025-01-02T23:45:04.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ed7d62ce-4351-4da4-ab94-13782d6db196 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
112025-01-02T23:45:04.420ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
122025-01-02T23:45:04.420ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
132025-01-02T23:45:04.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
142025-01-02T23:45:04.420ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
152025-01-02T23:45:04.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
162025-01-02T23:45:04.421ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21a27c6b-77bd-4944-8154-b74f56d79cee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edeee364-a24a-4b1f-a2f2-141a71f809d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edeee364-a24a-4b1f-a2f2-141a71f809d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 743217921 } })
172025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
182025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
192025-01-02T23:45:04.421ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = baf806d8-eb74-4256-91bc-030ba749ae9d
202025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
212025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.961\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d"}
222025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
232025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
242025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
262025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
272025-01-02T23:45:04.421ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
282025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
292025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
302025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
312025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
322025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
332025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
342025-01-02T23:45:04.421ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
352025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
362025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
372025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
382025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
392025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
402025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
412025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
422025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
432025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
442025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
452025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
462025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
472025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
482025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
492025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
502025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
512025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
522025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
532025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
542025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
552025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
562025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
572025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
582025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
592025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
602025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
612025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
622025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
632025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
642025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
652025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
662025-01-02T23:45:04.421ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-02 23:35:04.421773729 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
672025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
682025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
692025-01-02T23:45:04.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
702025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
712025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
722025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
732025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
742025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
752025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
762025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
772025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
782025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
792025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.463829ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
802025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
812025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
822025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
832025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
842025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
852025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
862025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
872025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
882025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
892025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
902025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
912025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
922025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
932025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
942025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
952025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
962025-01-02T23:45:04.422ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3cf11230-2b59-4cce-bb9f-d43f7cd85242.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cf07b438-4026-4d20-a0d8-212a50bca0d8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cf07b438-4026-4d20-a0d8-212a50bca0d8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 744413056 } })
972025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
982025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
992025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1002025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1012025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1022025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1032025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1042025-01-02T23:45:04.422ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.245396ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1052025-01-02T23:45:04.424ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.319594ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1062025-01-02T23:45:04.424ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1072025-01-02T23:45:04.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1082025-01-02T23:45:04.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1092025-01-02T23:45:04.426ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1102025-01-02T23:45:04.426ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1112025-01-02T23:45:04.426ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.58223ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1122025-01-02T23:45:04.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1132025-01-02T23:45:04.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1142025-01-02T23:45:04.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1152025-01-02T23:45:04.427ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1162025-01-02T23:45:04.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1172025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1182025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1192025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1202025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1212025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1222025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1232025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1242025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1252025-01-02T23:45:04.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1262025-01-02T23:45:04.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272025-01-02T23:45:04.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1282025-01-02T23:45:04.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1292025-01-02T23:45:04.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1302025-01-02T23:45:04.430ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
1312025-01-02T23:45:04.430ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
1322025-01-02T23:45:04.430ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
1332025-01-02T23:45:04.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1342025-01-02T23:45:04.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1352025-01-02T23:45:04.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1362025-01-02T23:45:04.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1372025-01-02T23:45:04.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1382025-01-02T23:45:04.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1392025-01-02T23:45:04.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1402025-01-02T23:45:04.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1412025-01-02T23:45:04.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1422025-01-02T23:45:04.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1432025-01-02T23:45:04.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1442025-01-02T23:45:04.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.251418ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
1452025-01-02T23:45:04.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 757278056 } })
1462025-01-02T23:45:04.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1472025-01-02T23:45:04.435ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1482025-01-02T23:45:04.435ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1492025-01-02T23:45:04.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1502025-01-02T23:45:04.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1512025-01-02T23:45:04.435ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-02 23:35:04.421773729 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1522025-01-02T23:45:04.435ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.204787ms iteration = 12 status = {"expiration":"2025-01-02T23:35:04.421773729Z","pruned":[]}
1532025-01-02T23:45:04.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1542025-01-02T23:45:04.438ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 760792032 } })
1552025-01-02T23:45:04.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1562025-01-02T23:45:04.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1572025-01-02T23:45:04.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1582025-01-02T23:45:04.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1592025-01-02T23:45:04.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1602025-01-02T23:45:04.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1612025-01-02T23:45:04.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1622025-01-02T23:45:04.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1632025-01-02T23:45:04.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1642025-01-02T23:45:04.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1652025-01-02T23:45:04.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1662025-01-02T23:45:04.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 765819818 } })
1672025-01-02T23:45:04.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
1682025-01-02T23:45:04.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1692025-01-02T23:45:04.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1702025-01-02T23:45:04.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1712025-01-02T23:45:04.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1722025-01-02T23:45:04.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1732025-01-02T23:45:04.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1742025-01-02T23:45:04.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1752025-01-02T23:45:04.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762025-01-02T23:45:04.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1772025-01-02T23:45:04.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1782025-01-02T23:45:04.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1792025-01-02T23:45:04.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.615367ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
1802025-01-02T23:45:04.467ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1812025-01-02T23:45:04.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1822025-01-02T23:45:04.478ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1832025-01-02T23:45:04.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1842025-01-02T23:45:04.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.395838ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1852025-01-02T23:45:04.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862025-01-02T23:45:04.482ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1872025-01-02T23:45:04.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1882025-01-02T23:45:04.483ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1892025-01-02T23:45:04.483ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1902025-01-02T23:45:04.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1912025-01-02T23:45:04.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1922025-01-02T23:45:04.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
1932025-01-02T23:45:04.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1942025-01-02T23:45:04.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1952025-01-02T23:45:04.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1962025-01-02T23:45:04.486ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
1972025-01-02T23:45:04.486ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
1982025-01-02T23:45:04.486ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 65.139826ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
1992025-01-02T23:45:04.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2002025-01-02T23:45:04.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2012025-01-02T23:45:04.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2022025-01-02T23:45:04.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2032025-01-02T23:45:04.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042025-01-02T23:45:04.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2052025-01-02T23:45:04.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2062025-01-02T23:45:04.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2072025-01-02T23:45:04.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2082025-01-02T23:45:04.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2092025-01-02T23:45:04.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2102025-01-02T23:45:04.494ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2112025-01-02T23:45:04.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.388301ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2122025-01-02T23:45:04.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2132025-01-02T23:45:04.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2142025-01-02T23:45:04.521ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2152025-01-02T23:45:04.521ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2162025-01-02T23:45:04.521ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2172025-01-02T23:45:04.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2182025-01-02T23:45:04.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2192025-01-02T23:45:04.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2202025-01-02T23:45:04.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2212025-01-02T23:45:04.552ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2222025-01-02T23:45:04.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
2232025-01-02T23:45:04.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2242025-01-02T23:45:04.646ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2252025-01-02T23:45:04.646ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "059e9ec1-7dfa-4858-9877-c08477031b41", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:03 GMT"} })
2262025-01-02T23:45:04.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2272025-01-02T23:45:04.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2282025-01-02T23:45:04.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2292025-01-02T23:45:04.652ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2302025-01-02T23:45:04.653ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5432e2de-d7c5-4dcd-9c92-38caf31c5ffd", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:03 GMT"} })
2312025-01-02T23:45:04.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2322025-01-02T23:45:04.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2332025-01-02T23:45:04.660ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2342025-01-02T23:45:04.661ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2352025-01-02T23:45:04.661ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "916acdc3-0e7b-4503-93a2-610b02eb9f44", "content-length": "372", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
2362025-01-02T23:45:04.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2372025-01-02T23:45:04.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2382025-01-02T23:45:04.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a zone_address = fd00:1122:3344:101::2
2392025-01-02T23:45:04.665ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2402025-01-02T23:45:04.665ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7897e2d9-7c16-44ae-be6d-e397ec51d110", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:03 GMT"} })
2412025-01-02T23:45:04.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2422025-01-02T23:45:04.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2432025-01-02T23:45:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2442025-01-02T23:45:04.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
2452025-01-02T23:45:04.679ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 257.596555ms iteration = 26 status = {"physical_disks_added":0}
2462025-01-02T23:45:04.682ZINFOnexus (BackgroundTasks): set region f6860594-401e-4bf6-b77a-6f729a651c1f port as 19000 background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:133
2472025-01-02T23:45:04.682ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 261.148293ms iteration = 12 status = {"errors":[],"found_port_ok":["set region f6860594-401e-4bf6-b77a-6f729a651c1f port as 19000"]}
2482025-01-02T23:45:04.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
2492025-01-02T23:45:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 270.585477ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
2502025-01-02T23:45:04.696ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2512025-01-02T23:45:04.696ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2522025-01-02T23:45:04.696ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 274.64133ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2532025-01-02T23:45:04.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 281.260977ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2542025-01-02T23:45:04.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2552025-01-02T23:45:04.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2562025-01-02T23:45:04.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2572025-01-02T23:45:04.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2582025-01-02T23:45:04.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592025-01-02T23:45:04.706ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2602025-01-02T23:45:04.706ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 074636c4-f52c-4c82-954e-efd9d4812db6 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2612025-01-02T23:45:04.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2622025-01-02T23:45:04.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2632025-01-02T23:45:04.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2642025-01-02T23:45:04.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652025-01-02T23:45:04.708ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2662025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2672025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2682025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fcb040b0-258e-4085-9f33-f6685a425510", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2692025-01-02T23:45:04.709ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2702025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2712025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2722025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2732025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2742025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2752025-01-02T23:45:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2762025-01-02T23:45:04.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2772025-01-02T23:45:04.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2782025-01-02T23:45:04.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8a1161d7-6d62-4983-bc09-f43d060ae472, lookup_type: ById(8a1161d7-6d62-4983-bc09-f43d060ae472) } result = Ok(())
2792025-01-02T23:45:04.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2802025-01-02T23:45:04.711ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8475f3ac-b4f5-4d54-9065-2ea8705c031b", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2812025-01-02T23:45:04.711ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2822025-01-02T23:45:04.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2832025-01-02T23:45:04.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2842025-01-02T23:45:04.713ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2852025-01-02T23:45:04.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2862025-01-02T23:45:04.713ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 292.210511ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
2872025-01-02T23:45:04.714ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e3107476-ee8b-4103-a715-4db73c9edc0f", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
2882025-01-02T23:45:04.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2892025-01-02T23:45:04.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 292.671118ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2902025-01-02T23:45:04.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2912025-01-02T23:45:04.715ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 293.770171ms iteration = 23 status = 0
2922025-01-02T23:45:04.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2932025-01-02T23:45:04.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2942025-01-02T23:45:04.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2952025-01-02T23:45:04.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2962025-01-02T23:45:04.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2972025-01-02T23:45:04.723ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2982025-01-02T23:45:04.723ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2992025-01-02T23:45:04.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8089a4db-9506-49a7-aecb-cf203e898123", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3002025-01-02T23:45:04.726ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 304.911108ms iteration = 23 status = {}
3012025-01-02T23:45:04.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022025-01-02T23:45:04.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 318.00933ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3032025-01-02T23:45:04.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3042025-01-02T23:45:04.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3052025-01-02T23:45:04.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3062025-01-02T23:45:04.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3072025-01-02T23:45:04.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3082025-01-02T23:45:04.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3092025-01-02T23:45:04.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3102025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 074636c4-f52c-4c82-954e-efd9d4812db6 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3112025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3122025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-02 23:34:06.342386 UTC dns_group = internal generation = 1
3132025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 322.680191ms iteration = 12 status = {"generation":1}
3142025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3152025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a8c4f8d-ef7b-4396-aa86-4770ac83fa25 dns_zone_name = oxide.test found_so_far = 0 version = 2
3162025-01-02T23:45:04.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3172025-01-02T23:45:04.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3182025-01-02T23:45:04.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3192025-01-02T23:45:04.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3202025-01-02T23:45:04.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3212025-01-02T23:45:04.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3222025-01-02T23:45:04.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3232025-01-02T23:45:04.745ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-02T23:33:58.545542Z, time_modified: 2025-01-02T23:33:58.545542Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, db_silo: Silo { identity: SiloIdentity { id: 31564a6d-adef-486f-8af0-44d369c942f7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-02T23:34:09.297095Z, time_modified: 2025-01-02T23:34:09.297095Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, db_silo: Silo { identity: SiloIdentity { id: 31564a6d-adef-486f-8af0-44d369c942f7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-02T23:34:09.297095Z, time_modified: 2025-01-02T23:34:09.297095Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
3242025-01-02T23:45:04.745ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 324.350683ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"31564a6d-adef-486f-8af0-44d369c942f7","tls_certs":["57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f"]}},"default_endpoint":{"silo_id":"31564a6d-adef-486f-8af0-44d369c942f7","tls_certs":["57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3252025-01-02T23:45:04.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3262025-01-02T23:45:04.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3272025-01-02T23:45:04.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3282025-01-02T23:45:04.749ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a8c4f8d-ef7b-4396-aa86-4770ac83fa25 dns_zone_name = oxide.test found_so_far = 1 version = 2
3292025-01-02T23:45:04.749ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3302025-01-02T23:45:04.749ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-02 23:34:09.381030 UTC dns_group = external generation = 2
3312025-01-02T23:45:04.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 328.237574ms iteration = 12 status = {"generation":2}
3322025-01-02T23:45:04.772ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3332025-01-02T23:45:04.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 350.950903ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3342025-01-02T23:45:04.786ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 364.391ms iteration = 23 status = {}
3352025-01-02T23:45:04.837ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3362025-01-02T23:45:04.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2fcccf87-9276-4850-b4ae-2aa526bbce30", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3372025-01-02T23:45:04.838ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3382025-01-02T23:45:04.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6f7cd66b-31e2-4311-8d7c-90c7fc7619a5", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3392025-01-02T23:45:04.839ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3402025-01-02T23:45:04.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5e4a6de6-85be-4edf-beff-fa0b6f777de8", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3412025-01-02T23:45:04.841ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3422025-01-02T23:45:04.844ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3432025-01-02T23:45:04.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 422.404742ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3442025-01-02T23:45:04.879ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3452025-01-02T23:45:04.879ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "636fc8d7-27cc-4a75-a2de-c0d531b56192", "content-length": "1", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3462025-01-02T23:45:04.881ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3472025-01-02T23:45:04.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3482025-01-02T23:45:04.883ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 461.82872ms iteration = 23 status = null
3492025-01-02T23:45:04.895ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3502025-01-02T23:45:04.896ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f1c1e9f-5405-4c6d-9e97-444ae1040901", "content-length": "691", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3512025-01-02T23:45:04.896ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3522025-01-02T23:45:04.896ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3532025-01-02T23:45:04.896ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3542025-01-02T23:45:04.897ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.49159ms iteration = 23 status = {}
3552025-01-02T23:45:04.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3562025-01-02T23:45:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3572025-01-02T23:45:04.955ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 74b7adc4-e4eb-4c16-b1dc-cfb7bdc9491d, rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a88f93f1-cd0a-4937-aa27-b4266d8f17ee) } rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
3582025-01-02T23:45:04.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3592025-01-02T23:45:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3602025-01-02T23:45:04.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3612025-01-02T23:45:04.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "21586be9-0e77-4e6f-b584-37a29b74bc4f", "content-length": "134", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3622025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3632025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a88f93f1-cd0a-4937-aa27-b4266d8f17ee
3642025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3652025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3662025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3672025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3682025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3692025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3702025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3712025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3722025-01-02T23:45:04.965ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
3732025-01-02T23:45:04.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3742025-01-02T23:45:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3752025-01-02T23:45:04.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3762025-01-02T23:45:04.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "41920ff8-9403-4698-ae40-629f063f7a3c", "content-length": "2", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3772025-01-02T23:45:04.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3782025-01-02T23:45:04.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "87aeab3c-976f-4fca-853e-513422a6f5cb", "content-length": "52", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3792025-01-02T23:45:04.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
3802025-01-02T23:45:04.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3812025-01-02T23:45:05.061ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6e82a70-f6af-4e0a-9324-ec59b24976dd", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3822025-01-02T23:45:05.061ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch = Switch0
3832025-01-02T23:45:05.061ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3842025-01-02T23:45:05.061ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "25fdeeaf-7f96-4f58-926a-43af0bdf9ab1", "content-length": "682", "date": "Thu, 02 Jan 2025 23:45:04 GMT"} })
3852025-01-02T23:45:05.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3862025-01-02T23:45:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3872025-01-02T23:45:05.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3882025-01-02T23:45:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3892025-01-02T23:45:05.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3902025-01-02T23:45:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3912025-01-02T23:45:05.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3922025-01-02T23:45:05.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3932025-01-02T23:45:05.077ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.423975ms iteration = 23 status = {}
3942025-01-02T23:45:05.250ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
3952025-01-02T23:45:05.250ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
3962025-01-02T23:45:05.280ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3972025-01-02T23:45:05.280ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63665
3982025-01-02T23:45:05.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63665 req_id = e501e11e-8c15-4dd5-b76d-182e069c67e0 roles = RoleSet { roles: {} } uri = /metrics/producers
3992025-01-02T23:45:05.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63665 req_id = e501e11e-8c15-4dd5-b76d-182e069c67e0 resource = Database result = Ok(()) uri = /metrics/producers
4002025-01-02T23:45:05.325ZINFOnexus: assigned collector to new producer collector_id = b48215cb-c824-4631-91b6-5d65088888bc file = nexus/src/app/oximeter.rs:76 producer_id = 56011122-5ef5-4404-a960-4d469159f36a
4012025-01-02T23:45:05.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44599 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63665 req_id = e501e11e-8c15-4dd5-b76d-182e069c67e0 response_code = 201 uri = /metrics/producers
4022025-01-02T23:45:05.325ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e501e11e-8c15-4dd5-b76d-182e069c67e0", "content-length": "41", "date": "Thu, 02 Jan 2025 23:45:05 GMT"} })
4032025-01-02T23:45:05.327ZDEBGnexus (producer-registration-task): registered with nexus successfully
4042025-01-02T23:45:05.327ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
4052025-01-02T23:45:05.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b8ffea11-4ca4-4e37-97bf-b4eafd4b7b99 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4062025-01-02T23:45:05.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b8ffea11-4ca4-4e37-97bf-b4eafd4b7b99 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4072025-01-02T23:45:05.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b8ffea11-4ca4-4e37-97bf-b4eafd4b7b99 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4082025-01-02T23:45:06.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d23e040e-25cd-40b2-a89a-c69edb65e2d9 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4092025-01-02T23:45:06.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d23e040e-25cd-40b2-a89a-c69edb65e2d9 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4102025-01-02T23:45:06.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d23e040e-25cd-40b2-a89a-c69edb65e2d9 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4112025-01-02T23:45:07.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 16eb0ba8-868c-4f62-a6f2-b4e048643ceb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4122025-01-02T23:45:07.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 16eb0ba8-868c-4f62-a6f2-b4e048643ceb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4132025-01-02T23:45:07.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 16eb0ba8-868c-4f62-a6f2-b4e048643ceb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4142025-01-02T23:45:08.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8f6d3626-781f-48d1-9347-c2f55de071de roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4152025-01-02T23:45:08.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8f6d3626-781f-48d1-9347-c2f55de071de resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4162025-01-02T23:45:08.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8f6d3626-781f-48d1-9347-c2f55de071de response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4172025-01-02T23:45:09.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ebe86f8a-83e2-4820-b87c-65ef14846b22 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4182025-01-02T23:45:09.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ebe86f8a-83e2-4820-b87c-65ef14846b22 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4192025-01-02T23:45:09.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ebe86f8a-83e2-4820-b87c-65ef14846b22 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4202025-01-02T23:45:10.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 931e95b6-ec8a-42f3-8f72-3a461005e90e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4212025-01-02T23:45:10.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 931e95b6-ec8a-42f3-8f72-3a461005e90e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4222025-01-02T23:45:10.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 931e95b6-ec8a-42f3-8f72-3a461005e90e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4232025-01-02T23:45:11.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a0e05e45-1cdb-4ee1-814e-0d287e1f7ac8 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4242025-01-02T23:45:11.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a0e05e45-1cdb-4ee1-814e-0d287e1f7ac8 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4252025-01-02T23:45:11.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a0e05e45-1cdb-4ee1-814e-0d287e1f7ac8 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4262025-01-02T23:45:12.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 01d3882a-4f02-4365-b215-5dcf1c9a0ced roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4272025-01-02T23:45:12.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 01d3882a-4f02-4365-b215-5dcf1c9a0ced resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4282025-01-02T23:45:12.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 01d3882a-4f02-4365-b215-5dcf1c9a0ced response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4292025-01-02T23:45:13.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c873625d-71aa-4696-acb1-40302b6bb069 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4302025-01-02T23:45:13.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c873625d-71aa-4696-acb1-40302b6bb069 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4312025-01-02T23:45:13.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c873625d-71aa-4696-acb1-40302b6bb069 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4322025-01-02T23:45:13.719ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 404 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 228bb471-d895-4082-98ca-c89ea4916656 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
4332025-01-02T23:45:14.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
4342025-01-02T23:45:14.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4352025-01-02T23:45:14.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
4362025-01-02T23:45:14.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4372025-01-02T23:45:14.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4382025-01-02T23:45:14.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4392025-01-02T23:45:14.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4402025-01-02T23:45:14.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4412025-01-02T23:45:14.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4422025-01-02T23:45:14.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4432025-01-02T23:45:14.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4442025-01-02T23:45:14.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4452025-01-02T23:45:14.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4462025-01-02T23:45:14.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
4472025-01-02T23:45:14.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4482025-01-02T23:45:14.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4492025-01-02T23:45:14.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
4502025-01-02T23:45:14.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.034446ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
4512025-01-02T23:45:14.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4522025-01-02T23:45:14.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4532025-01-02T23:45:14.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.07175ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4542025-01-02T23:45:14.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 49329c4c-1df0-4d37-b6d4-9f48933ed615 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4552025-01-02T23:45:14.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 49329c4c-1df0-4d37-b6d4-9f48933ed615 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4562025-01-02T23:45:14.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 49329c4c-1df0-4d37-b6d4-9f48933ed615 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4572025-01-02T23:45:15.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3112d01a-b1a0-43a2-b466-11381ce99b96 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4582025-01-02T23:45:15.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3112d01a-b1a0-43a2-b466-11381ce99b96 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4592025-01-02T23:45:15.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3112d01a-b1a0-43a2-b466-11381ce99b96 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4602025-01-02T23:45:15.975ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1475748a-ec89-45fc-ad7a-f7cbb4ca5136 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-02T23:45:15.953208365Z }
4612025-01-02T23:45:15.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1475748a-ec89-45fc-ad7a-f7cbb4ca5136 roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
4622025-01-02T23:45:15.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1475748a-ec89-45fc-ad7a-f7cbb4ca5136 resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
4632025-01-02T23:45:16.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66242 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1475748a-ec89-45fc-ad7a-f7cbb4ca5136 response_code = 204 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
4642025-01-02T23:45:16.020ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b remote_addr = [fd00:1122:3344:101::1]:59558 req_id = efc162f0-ee96-4174-82ef-c3ed811a68e3 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-02T23:45:16.020550441Z }
4652025-01-02T23:45:16.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = efc162f0-ee96-4174-82ef-c3ed811a68e3 roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
4662025-01-02T23:45:16.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = efc162f0-ee96-4174-82ef-c3ed811a68e3 resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
4672025-01-02T23:45:16.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = efc162f0-ee96-4174-82ef-c3ed811a68e3 response_code = 204 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
4682025-01-02T23:45:16.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9c48a7c7-08c7-4219-8982-26b9f3c53352 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4692025-01-02T23:45:16.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9c48a7c7-08c7-4219-8982-26b9f3c53352 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4702025-01-02T23:45:16.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9c48a7c7-08c7-4219-8982-26b9f3c53352 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4712025-01-02T23:45:17.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 38975b33-bba5-445a-a345-40b4a7c2cbdf roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4722025-01-02T23:45:17.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 38975b33-bba5-445a-a345-40b4a7c2cbdf resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4732025-01-02T23:45:17.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 38975b33-bba5-445a-a345-40b4a7c2cbdf response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4742025-01-02T23:45:18.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 18248172-e497-4e15-9ec2-64a9f2b16f57 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4752025-01-02T23:45:18.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 18248172-e497-4e15-9ec2-64a9f2b16f57 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4762025-01-02T23:45:18.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 18248172-e497-4e15-9ec2-64a9f2b16f57 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4772025-01-02T23:45:19.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 756b26b5-6ee4-4c6e-bab4-b7001f799813 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4782025-01-02T23:45:19.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 756b26b5-6ee4-4c6e-bab4-b7001f799813 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4792025-01-02T23:45:19.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 756b26b5-6ee4-4c6e-bab4-b7001f799813 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4802025-01-02T23:45:20.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3d17f688-9c5c-419e-b291-b1a6c7744d97 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4812025-01-02T23:45:20.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3d17f688-9c5c-419e-b291-b1a6c7744d97 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4822025-01-02T23:45:20.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3d17f688-9c5c-419e-b291-b1a6c7744d97 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4832025-01-02T23:45:21.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 80af115c-7dee-4b15-ab06-f4827ba1d6b3 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4842025-01-02T23:45:21.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 80af115c-7dee-4b15-ab06-f4827ba1d6b3 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4852025-01-02T23:45:21.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 80af115c-7dee-4b15-ab06-f4827ba1d6b3 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4862025-01-02T23:45:22.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5edb045d-57d6-4a13-8b30-d0e6f07e18e8 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4872025-01-02T23:45:22.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5edb045d-57d6-4a13-8b30-d0e6f07e18e8 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4882025-01-02T23:45:22.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5edb045d-57d6-4a13-8b30-d0e6f07e18e8 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4892025-01-02T23:45:23.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 02b0b209-e8cf-458e-a09b-1e5e490ff9d4 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
4902025-01-02T23:45:23.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9c85c076-640f-4c26-b730-4fa3c1c18b9f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4912025-01-02T23:45:23.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9c85c076-640f-4c26-b730-4fa3c1c18b9f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4922025-01-02T23:45:23.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9c85c076-640f-4c26-b730-4fa3c1c18b9f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
4932025-01-02T23:45:24.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
4942025-01-02T23:45:24.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4952025-01-02T23:45:24.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
4962025-01-02T23:45:24.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4972025-01-02T23:45:24.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4982025-01-02T23:45:24.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4992025-01-02T23:45:24.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002025-01-02T23:45:24.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5012025-01-02T23:45:24.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5022025-01-02T23:45:24.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5032025-01-02T23:45:24.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5042025-01-02T23:45:24.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5052025-01-02T23:45:24.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.010621ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5062025-01-02T23:45:24.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5072025-01-02T23:45:24.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5082025-01-02T23:45:24.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5092025-01-02T23:45:24.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
5102025-01-02T23:45:24.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5112025-01-02T23:45:24.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5122025-01-02T23:45:24.471ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
5132025-01-02T23:45:24.471ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.537251ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
5142025-01-02T23:45:24.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 335f2d2c-40b8-4478-98d9-765bfe76830c roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5152025-01-02T23:45:24.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 335f2d2c-40b8-4478-98d9-765bfe76830c resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5162025-01-02T23:45:24.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 335f2d2c-40b8-4478-98d9-765bfe76830c response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5172025-01-02T23:45:25.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 397c7eb4-16cb-45e4-9ea3-66e3288c8538 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5182025-01-02T23:45:25.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 397c7eb4-16cb-45e4-9ea3-66e3288c8538 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5192025-01-02T23:45:25.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 397c7eb4-16cb-45e4-9ea3-66e3288c8538 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5202025-01-02T23:45:26.293ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 37292c60-921e-4862-a1c0-b652c6ee9495 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-02T23:45:26.293508567Z }
5212025-01-02T23:45:26.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 37292c60-921e-4862-a1c0-b652c6ee9495 roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5222025-01-02T23:45:26.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 37292c60-921e-4862-a1c0-b652c6ee9495 resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5232025-01-02T23:45:26.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 37292c60-921e-4862-a1c0-b652c6ee9495 response_code = 204 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5242025-01-02T23:45:26.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cedf79a3-3afa-4450-9d3c-19ddd9a4a947 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5252025-01-02T23:45:26.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cedf79a3-3afa-4450-9d3c-19ddd9a4a947 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5262025-01-02T23:45:26.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cedf79a3-3afa-4450-9d3c-19ddd9a4a947 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5272025-01-02T23:45:27.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 2befbdf0-14c8-4589-94cd-edfe9dc6f5e7 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5282025-01-02T23:45:27.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 2befbdf0-14c8-4589-94cd-edfe9dc6f5e7 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5292025-01-02T23:45:27.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 2befbdf0-14c8-4589-94cd-edfe9dc6f5e7 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5302025-01-02T23:45:28.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39247 req_id = dafe09b2-e667-4dd6-89b4-9400aaf405a3 roles = RoleSet { roles: {} } uri = /metrics/collectors/b48215cb-c824-4631-91b6-5d65088888bc/producers?sort_by=id_ascending
5312025-01-02T23:45:28.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39247 req_id = dafe09b2-e667-4dd6-89b4-9400aaf405a3 resource = Database result = Ok(()) uri = /metrics/collectors/b48215cb-c824-4631-91b6-5d65088888bc/producers?sort_by=id_ascending
5322025-01-02T23:45:28.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39247 req_id = dafe09b2-e667-4dd6-89b4-9400aaf405a3 response_code = 200 uri = /metrics/collectors/b48215cb-c824-4631-91b6-5d65088888bc/producers?sort_by=id_ascending
5332025-01-02T23:45:28.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39247 req_id = 9434c3ca-c8b7-4d55-902a-cd642403f626 roles = RoleSet { roles: {} } uri = /metrics/collectors/b48215cb-c824-4631-91b6-5d65088888bc/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjUwOTBjMy04NzFmLTQxODMtYmY3OS03ZDZlMmVmZjQwYzAifX0%3D
5342025-01-02T23:45:28.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39247 req_id = 9434c3ca-c8b7-4d55-902a-cd642403f626 resource = Database result = Ok(()) uri = /metrics/collectors/b48215cb-c824-4631-91b6-5d65088888bc/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjUwOTBjMy04NzFmLTQxODMtYmY3OS03ZDZlMmVmZjQwYzAifX0%3D
5352025-01-02T23:45:28.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39247 req_id = 9434c3ca-c8b7-4d55-902a-cd642403f626 response_code = 200 uri = /metrics/collectors/b48215cb-c824-4631-91b6-5d65088888bc/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjUwOTBjMy04NzFmLTQxODMtYmY3OS03ZDZlMmVmZjQwYzAifX0%3D
5362025-01-02T23:45:28.769ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-02T23:45:28.769049985Z }
5372025-01-02T23:45:28.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5382025-01-02T23:45:28.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5392025-01-02T23:45:28.777ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_needs_update = true
5402025-01-02T23:45:28.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5412025-01-02T23:45:28.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5422025-01-02T23:45:28.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5432025-01-02T23:45:28.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5442025-01-02T23:45:28.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5452025-01-02T23:45:28.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5462025-01-02T23:45:28.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5472025-01-02T23:45:28.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5482025-01-02T23:45:28.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5492025-01-02T23:45:28.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5502025-01-02T23:45:28.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5512025-01-02T23:45:28.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5522025-01-02T23:45:28.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5532025-01-02T23:45:28.819ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 31564a6d-adef-486f-8af0-44d369c942f7, lookup_type: ById(31564a6d-adef-486f-8af0-44d369c942f7) }, key: 42739ccf-2f26-4d7f-9106-56c79d73843f, lookup_type: ById(42739ccf-2f26-4d7f-9106-56c79d73843f) }, key: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2, lookup_type: ById(59da1fac-29cb-4f7b-9e6c-f100663b7ba2) } result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5542025-01-02T23:45:28.827ZINFOnexus (dropshot_internal): starting update saga for 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-02T23:45:28.769049985Z }
5552025-01-02T23:45:28.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58059 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef response_code = 204 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5562025-01-02T23:45:28.827ZDEBGnexus (dropshot_internal): preparing instance-update saga for 59da1fac-29cb-4f7b-9e6c-f100663b7ba2... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 900ba1da-def1-47ef-b252-3e0fa086faef uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5572025-01-02T23:45:28.827ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 711bc959-35a2-483f-a5f1-fd9810afeb7e uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-02T23:45:28.769049985Z }
5582025-01-02T23:45:28.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 711bc959-35a2-483f-a5f1-fd9810afeb7e roles = RoleSet { roles: {} } uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5592025-01-02T23:45:28.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 711bc959-35a2-483f-a5f1-fd9810afeb7e resource = Database result = Ok(()) uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5602025-01-02T23:45:28.829ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update
5612025-01-02T23:45:28.832ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"59da1fac-29cb-4f7b-9e6c-f100663b7ba2","lookup_type":{"ById":"59da1fac-29cb-4f7b-9e6c-f100663b7ba2"},"parent":{"key":"42739ccf-2f26-4d7f-9106-56c79d73843f","lookup_type":{"ById":"42739ccf-2f26-4d7f-9106-56c79d73843f"},"parent":{"key":"31564a6d-adef-486f-8af0-44d369c942f7","lookup_type":{"ById":"31564a6d-adef-486f-8af0-44d369c942f7"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5622025-01-02T23:45:28.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6379 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 711bc959-35a2-483f-a5f1-fd9810afeb7e response_code = 204 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
5632025-01-02T23:45:28.837ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update
5642025-01-02T23:45:28.867ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update
5652025-01-02T23:45:28.867ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5662025-01-02T23:45:28.869ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5672025-01-02T23:45:28.869ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
5682025-01-02T23:45:28.874ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5692025-01-02T23:45:28.874ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
5702025-01-02T23:45:28.877ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5712025-01-02T23:45:28.877ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
5722025-01-02T23:45:28.883ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5732025-01-02T23:45:28.883ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ede6b209-8917-44d6-84c6-b174533fb8a2")) node_id = 0 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
5742025-01-02T23:45:28.889ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
5752025-01-02T23:45:28.889ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
5762025-01-02T23:45:28.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e8914c4f-185b-4113-890d-16f1b6d116b9 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5772025-01-02T23:45:28.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e8914c4f-185b-4113-890d-16f1b6d116b9 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5782025-01-02T23:45:28.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e8914c4f-185b-4113-890d-16f1b6d116b9 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
5792025-01-02T23:45:28.905ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update
5802025-01-02T23:45:28.908ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5812025-01-02T23:45:28.908ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5822025-01-02T23:45:28.910ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5832025-01-02T23:45:28.910ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5842025-01-02T23:45:28.912ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5852025-01-02T23:45:28.912ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5862025-01-02T23:45:28.914ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5872025-01-02T23:45:28.914ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5882025-01-02T23:45:28.915ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5892025-01-02T23:45:28.916ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5902025-01-02T23:45:28.917ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5912025-01-02T23:45:28.917ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5922025-01-02T23:45:28.918ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5932025-01-02T23:45:28.921ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 31564a6d-adef-486f-8af0-44d369c942f7, lookup_type: ById(31564a6d-adef-486f-8af0-44d369c942f7) }, key: 42739ccf-2f26-4d7f-9106-56c79d73843f, lookup_type: ById(42739ccf-2f26-4d7f-9106-56c79d73843f) }, key: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2, lookup_type: ById(59da1fac-29cb-4f7b-9e6c-f100663b7ba2) } result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5942025-01-02T23:45:28.924ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance updater_id = ede6b209-8917-44d6-84c6-b174533fb8a2
5952025-01-02T23:45:28.924ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5962025-01-02T23:45:28.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5972025-01-02T23:45:28.932ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance updater_id = ede6b209-8917-44d6-84c6-b174533fb8a2
5982025-01-02T23:45:28.932ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
5992025-01-02T23:45:28.932ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance
6002025-01-02T23:45:28.936ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 locked_gen = Generation(Generation(2)) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = LockInstance updater_id = ede6b209-8917-44d6-84c6-b174533fb8a2
6012025-01-02T23:45:28.936ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6022025-01-02T23:45:28.936ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ede6b209-8917-44d6-84c6-b174533fb8a2")}) node_id = 1 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
6032025-01-02T23:45:28.939ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6042025-01-02T23:45:28.939ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
6052025-01-02T23:45:28.945ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6062025-01-02T23:45:28.945ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6072025-01-02T23:45:28.946ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6082025-01-02T23:45:28.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6092025-01-02T23:45:28.947ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6102025-01-02T23:45:28.948ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6112025-01-02T23:45:28.949ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6122025-01-02T23:45:28.952ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 31564a6d-adef-486f-8af0-44d369c942f7, lookup_type: ById(31564a6d-adef-486f-8af0-44d369c942f7) }, key: 42739ccf-2f26-4d7f-9106-56c79d73843f, lookup_type: ById(42739ccf-2f26-4d7f-9106-56c79d73843f) }, key: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2, lookup_type: ById(59da1fac-29cb-4f7b-9e6c-f100663b7ba2) } result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6132025-01-02T23:45:28.952ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6142025-01-02T23:45:28.952ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
6152025-01-02T23:45:28.963ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 9252d818-5197-4f80-82d2-cbb5aae2539b, time_created: 2025-01-02T23:45:07.890874Z, time_deleted: None, instance_id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2, sled_id: 8a1161d7-6d62-4983-bc09-f43d060ae472, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-02T23:45:28.769049Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-02T23:45:05.115087Z, gen: Generation(Generation(3)), propolis_id: Some(9252d818-5197-4f80-82d2-cbb5aae2539b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(9252d818-5197-4f80-82d2-cbb5aae2539b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-02T23:45:28.963620252Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
6162025-01-02T23:45:28.966ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6172025-01-02T23:45:28.966ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"59da1fac-29cb-4f7b-9e6c-f100663b7ba2","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"9252d818-5197-4f80-82d2-cbb5aae2539b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"59da1fac-29cb-4f7b-9e6c-f100663b7ba2","lookup_type":{"ById":"59da1fac-29cb-4f7b-9e6c-f100663b7ba2"},"parent":{"key":"42739ccf-2f26-4d7f-9106-56c79d73843f","lookup_type":{"ById":"42739ccf-2f26-4d7f-9106-56c79d73843f"},"parent":{"key":"31564a6d-adef-486f-8af0-44d369c942f7","lookup_type":{"ById":"31564a6d-adef-486f-8af0-44d369c942f7"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"ede6b209-8917-44d6-84c6-b174533fb8a2"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"42739ccf-2f26-4d7f-9106-56c79d73843f","ram_diff":1073741824},"destroy_active_vmm":"9252d818-5197-4f80-82d2-cbb5aae2539b","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-02T23:45:28.963620252Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6182025-01-02T23:45:28.966ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6192025-01-02T23:45:28.998ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6202025-01-02T23:45:28.998ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6212025-01-02T23:45:28.998ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6222025-01-02T23:45:28.998ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6232025-01-02T23:45:29.002ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6242025-01-02T23:45:29.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6252025-01-02T23:45:29.006ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6262025-01-02T23:45:29.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6272025-01-02T23:45:29.010ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6282025-01-02T23:45:29.010ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5d156645-4807-43f1-9d4d-318d1894430c")) node_id = 0 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6292025-01-02T23:45:29.013ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6302025-01-02T23:45:29.013ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6312025-01-02T23:45:29.018ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 parent_lock = UpdaterLock { updater_id: ede6b209-8917-44d6-84c6-b174533fb8a2, locked_gen: Generation(Generation(2)) } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6322025-01-02T23:45:29.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = BecomeUpdater
6332025-01-02T23:45:29.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = BecomeUpdater
6342025-01-02T23:45:29.031ZDEBGnexus (SagaExecutor): inherited lock from ede6b209-8917-44d6-84c6-b174533fb8a2 to 5d156645-4807-43f1-9d4d-318d1894430c actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = ede6b209-8917-44d6-84c6-b174533fb8a2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = BecomeUpdater updater_id = 5d156645-4807-43f1-9d4d-318d1894430c
6352025-01-02T23:45:29.031ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6362025-01-02T23:45:29.031ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6372025-01-02T23:45:29.031ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5d156645-4807-43f1-9d4d-318d1894430c")}) node_id = 1 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6382025-01-02T23:45:29.034ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6392025-01-02T23:45:29.034ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6402025-01-02T23:45:29.038ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6412025-01-02T23:45:29.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6422025-01-02T23:45:29.041ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6432025-01-02T23:45:29.041ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6442025-01-02T23:45:29.044ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6452025-01-02T23:45:29.047ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2
6462025-01-02T23:45:29.047ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UpdateNetworkConfig
6472025-01-02T23:45:29.048ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UpdateNetworkConfig
6482025-01-02T23:45:29.053ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UpdateNetworkConfig
6492025-01-02T23:45:29.054ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UpdateNetworkConfig
6502025-01-02T23:45:29.060ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
6512025-01-02T23:45:29.060ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UpdateNetworkConfig
6522025-01-02T23:45:29.060ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UpdateNetworkConfig
6532025-01-02T23:45:29.062ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
6542025-01-02T23:45:29.062ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6552025-01-02T23:45:29.063ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6562025-01-02T23:45:29.064ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
6572025-01-02T23:45:29.065ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
6582025-01-02T23:45:29.065ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6592025-01-02T23:45:29.065ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6602025-01-02T23:45:29.069ZDEBGnexus: notifying dendrite of updates instance_id = Some(59da1fac-29cb-4f7b-9e6c-f100663b7ba2 (instance)) switch = switch0
6612025-01-02T23:45:29.070ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1650, tv_nsec: 391771251 } })
6622025-01-02T23:45:29.070ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
6632025-01-02T23:45:29.101ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6642025-01-02T23:45:29.101ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6652025-01-02T23:45:29.102ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75ce92f9-0a3e-4d94-962f-aadc1e8e8c8c", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:29 GMT"} })
6662025-01-02T23:45:29.102ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6672025-01-02T23:45:29.102ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6682025-01-02T23:45:29.132ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
6692025-01-02T23:45:29.132ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "79fa8590-4048-4963-9458-8bff507b4351", "content-length": "4", "date": "Thu, 02 Jan 2025 23:45:28 GMT"} })
6702025-01-02T23:45:29.133ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6712025-01-02T23:45:29.133ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6722025-01-02T23:45:29.136ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6732025-01-02T23:45:29.136ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6742025-01-02T23:45:29.145ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6752025-01-02T23:45:29.145ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6762025-01-02T23:45:29.263ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-02T23:45:29.148247Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 31564a6d-adef-486f-8af0-44d369c942f7, time_modified: Some(2025-01-02T23:45:29.148247Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 42739ccf-2f26-4d7f-9106-56c79d73843f, time_modified: Some(2025-01-02T23:45:29.148247Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6772025-01-02T23:45:29.263ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6782025-01-02T23:45:29.263ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6792025-01-02T23:45:29.268ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6802025-01-02T23:45:29.268ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6812025-01-02T23:45:29.275ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6822025-01-02T23:45:29.275ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UnassignOximeterProducer
6832025-01-02T23:45:29.276ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UnassignOximeterProducer
6842025-01-02T23:45:29.285ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = b48215cb-c824-4631-91b6-5d65088888bc producer_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6852025-01-02T23:45:29.285ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UnassignOximeterProducer
6862025-01-02T23:45:29.285ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = UnassignOximeterProducer
6872025-01-02T23:45:29.324ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6882025-01-02T23:45:29.327ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/59da1fac-29cb-4f7b-9e6c-f100663b7ba2
6892025-01-02T23:45:29.341ZDEBGnexus (SagaExecutor): client response oximeter-collector = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/59da1fac-29cb-4f7b-9e6c-f100663b7ba2", status: 204, headers: {"x-request-id": "17ead222-ef79-49d6-b32d-ad0bd729141b", "date": "Thu, 02 Jan 2025 23:45:29 GMT"} }) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6902025-01-02T23:45:29.341ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = b48215cb-c824-4631-91b6-5d65088888bc producer_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6912025-01-02T23:45:29.342ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6922025-01-02T23:45:29.342ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6932025-01-02T23:45:29.345ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
6942025-01-02T23:45:29.345ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
6952025-01-02T23:45:29.349ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 lock = UpdaterLock { updater_id: 5d156645-4807-43f1-9d4d-318d1894430c, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-02T23:45:28.963620252Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6962025-01-02T23:45:29.349ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = CommitInstanceUpdates
6972025-01-02T23:45:29.350ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = CommitInstanceUpdates
6982025-01-02T23:45:29.385ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 new_runtime = InstanceRuntimeState { time_updated: 2025-01-02T23:45:28.963620252Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
6992025-01-02T23:45:29.385ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7002025-01-02T23:45:29.385ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7012025-01-02T23:45:29.385ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
7022025-01-02T23:45:29.385ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
7032025-01-02T23:45:29.385ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7042025-01-02T23:45:29.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7052025-01-02T23:45:29.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7062025-01-02T23:45:29.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7072025-01-02T23:45:29.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7082025-01-02T23:45:29.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092025-01-02T23:45:29.388ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7102025-01-02T23:45:29.388ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7112025-01-02T23:45:29.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7122025-01-02T23:45:29.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7132025-01-02T23:45:29.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7142025-01-02T23:45:29.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152025-01-02T23:45:29.392ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7162025-01-02T23:45:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7172025-01-02T23:45:29.392ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7182025-01-02T23:45:29.392ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("59da1fac-29cb-4f7b-9e6c-f100663b7ba2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("9252d818-5197-4f80-82d2-cbb5aae2539b")}) node_id = 7 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7192025-01-02T23:45:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7202025-01-02T23:45:29.395ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7212025-01-02T23:45:29.395ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7222025-01-02T23:45:29.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7232025-01-02T23:45:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7242025-01-02T23:45:29.398ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7252025-01-02T23:45:29.398ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7262025-01-02T23:45:29.402ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7272025-01-02T23:45:29.402ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7282025-01-02T23:45:29.405ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
7292025-01-02T23:45:29.405ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ReleaseSledResources
7302025-01-02T23:45:29.405ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ReleaseSledResources
7312025-01-02T23:45:29.415ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7322025-01-02T23:45:29.415ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7332025-01-02T23:45:29.419ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7342025-01-02T23:45:29.419ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7352025-01-02T23:45:29.422ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
7362025-01-02T23:45:29.422ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = MarkVmmDeleted
7372025-01-02T23:45:29.423ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = MarkVmmDeleted
7382025-01-02T23:45:29.433ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7392025-01-02T23:45:29.433ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7402025-01-02T23:45:29.441ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7412025-01-02T23:45:29.441ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7422025-01-02T23:45:29.445ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7432025-01-02T23:45:29.445ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7442025-01-02T23:45:29.449ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7452025-01-02T23:45:29.449ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7462025-01-02T23:45:29.452ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7472025-01-02T23:45:29.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7482025-01-02T23:45:29.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7492025-01-02T23:45:29.457ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7502025-01-02T23:45:29.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7512025-01-02T23:45:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7522025-01-02T23:45:29.487ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7532025-01-02T23:45:29.487ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7542025-01-02T23:45:29.487ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9018bde-9ee2-4003-9619-ddc680b307a5", "content-length": "372", "date": "Thu, 02 Jan 2025 23:45:28 GMT"} })
7552025-01-02T23:45:29.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7562025-01-02T23:45:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7572025-01-02T23:45:29.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582025-01-02T23:45:29.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7592025-01-02T23:45:29.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7602025-01-02T23:45:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7612025-01-02T23:45:29.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622025-01-02T23:45:29.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7632025-01-02T23:45:29.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7642025-01-02T23:45:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7652025-01-02T23:45:29.506ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7662025-01-02T23:45:29.506ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7672025-01-02T23:45:29.506ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "42296786-0583-45b9-b671-2fbcb131690b", "date": "Thu, 02 Jan 2025 23:45:28 GMT"} })
7682025-01-02T23:45:29.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692025-01-02T23:45:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702025-01-02T23:45:29.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712025-01-02T23:45:29.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722025-01-02T23:45:29.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7732025-01-02T23:45:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742025-01-02T23:45:29.515ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7752025-01-02T23:45:29.515ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7762025-01-02T23:45:29.515ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "be73302e-95f8-4f9a-a30f-7c87ad4e3d94", "date": "Thu, 02 Jan 2025 23:45:28 GMT"} })
7772025-01-02T23:45:29.517ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7782025-01-02T23:45:29.517ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7792025-01-02T23:45:29.518ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 132.825416ms iteration = 24 status = {}
7802025-01-02T23:45:29.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7812025-01-02T23:45:29.522ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 31564a6d-adef-486f-8af0-44d369c942f7, lookup_type: ById(31564a6d-adef-486f-8af0-44d369c942f7) }, key: 42739ccf-2f26-4d7f-9106-56c79d73843f, lookup_type: ById(42739ccf-2f26-4d7f-9106-56c79d73843f) }, key: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2, lookup_type: ById(59da1fac-29cb-4f7b-9e6c-f100663b7ba2) } result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7822025-01-02T23:45:29.522ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7832025-01-02T23:45:29.522ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_node = ChainSuccessorSaga
7842025-01-02T23:45:29.531ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7852025-01-02T23:45:29.531ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "467b6615-c883-45d1-b89d-a9df0a763a62", "content-length": "691", "date": "Thu, 02 Jan 2025 23:45:28 GMT"} })
7862025-01-02T23:45:29.531ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7872025-01-02T23:45:29.531ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7882025-01-02T23:45:29.531ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7892025-01-02T23:45:29.533ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 148.283699ms iteration = 24 status = {}
7902025-01-02T23:45:29.537ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update
7912025-01-02T23:45:29.537ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7922025-01-02T23:45:29.537ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7932025-01-02T23:45:29.540ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7942025-01-02T23:45:29.540ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7952025-01-02T23:45:29.543ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7962025-01-02T23:45:29.543ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7972025-01-02T23:45:29.546ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 sec_id = 56011122-5ef5-4404-a960-4d469159f36a
7982025-01-02T23:45:29.546ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6
7992025-01-02T23:45:29.556ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update sec_id = 56011122-5ef5-4404-a960-4d469159f36a
8002025-01-02T23:45:29.557ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 saga_name = instance-update saga_result = SagaResult { saga_id: 1dc0e003-e72b-475f-9ff6-c1be1f00efe6, saga_log: SagaLog { saga_id: 1dc0e003-e72b-475f-9ff6-c1be1f00efe6, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("5d156645-4807-43f1-9d4d-318d1894430c")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5d156645-4807-43f1-9d4d-318d1894430c")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("59da1fac-29cb-4f7b-9e6c-f100663b7ba2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("9252d818-5197-4f80-82d2-cbb5aae2539b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("59da1fac-29cb-4f7b-9e6c-f100663b7ba2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("9252d818-5197-4f80-82d2-cbb5aae2539b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("5d156645-4807-43f1-9d4d-318d1894430c"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("5d156645-4807-43f1-9d4d-318d1894430c")}} }) }
8012025-01-02T23:45:29.557ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 1dc0e003-e72b-475f-9ff6-c1be1f00efe6 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update
8022025-01-02T23:45:29.557ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
8032025-01-02T23:45:29.557ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
8042025-01-02T23:45:29.561ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 56011122-5ef5-4404-a960-4d469159f36a
8052025-01-02T23:45:29.561ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
8062025-01-02T23:45:29.563ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 56011122-5ef5-4404-a960-4d469159f36a
8072025-01-02T23:45:29.563ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
8082025-01-02T23:45:29.568ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 sec_id = 56011122-5ef5-4404-a960-4d469159f36a
8092025-01-02T23:45:29.568ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d912dea9-828a-4210-82c2-bd4ad949d120
8102025-01-02T23:45:29.601ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update sec_id = 56011122-5ef5-4404-a960-4d469159f36a
8112025-01-02T23:45:29.601ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = d912dea9-828a-4210-82c2-bd4ad949d120 saga_name = start-instance-update saga_result = SagaResult { saga_id: d912dea9-828a-4210-82c2-bd4ad949d120, saga_log: SagaLog { saga_id: d912dea9-828a-4210-82c2-bd4ad949d120, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("ede6b209-8917-44d6-84c6-b174533fb8a2")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ede6b209-8917-44d6-84c6-b174533fb8a2")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("ede6b209-8917-44d6-84c6-b174533fb8a2"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("ede6b209-8917-44d6-84c6-b174533fb8a2")}} }) }
8122025-01-02T23:45:29.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 332eb5f5-e028-4459-acf6-eecc67a4b44b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8132025-01-02T23:45:29.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 332eb5f5-e028-4459-acf6-eecc67a4b44b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8142025-01-02T23:45:29.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 332eb5f5-e028-4459-acf6-eecc67a4b44b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8152025-01-02T23:45:30.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 023cf129-850e-4563-aa9c-e6a4b567a464 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8162025-01-02T23:45:30.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 023cf129-850e-4563-aa9c-e6a4b567a464 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8172025-01-02T23:45:30.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 023cf129-850e-4563-aa9c-e6a4b567a464 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8182025-01-02T23:45:31.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f94ff970-14aa-41d3-a59d-2b5b6a7da647 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8192025-01-02T23:45:31.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f94ff970-14aa-41d3-a59d-2b5b6a7da647 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8202025-01-02T23:45:31.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f94ff970-14aa-41d3-a59d-2b5b6a7da647 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8212025-01-02T23:45:32.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bd8e09e7-5485-4f45-a613-f78436a8238c roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8222025-01-02T23:45:32.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bd8e09e7-5485-4f45-a613-f78436a8238c resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8232025-01-02T23:45:32.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bd8e09e7-5485-4f45-a613-f78436a8238c response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8242025-01-02T23:45:33.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 546 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 089a4fe7-1bbc-4a0a-b5ec-5850dc5ff664 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
8252025-01-02T23:45:34.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 26e53183-05f9-46b0-bca3-9c42f3d46c1a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8262025-01-02T23:45:34.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 26e53183-05f9-46b0-bca3-9c42f3d46c1a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8272025-01-02T23:45:34.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 26e53183-05f9-46b0-bca3-9c42f3d46c1a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
8282025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
8292025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
8302025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8312025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8322025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
8332025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
8342025-01-02T23:45:34.422ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8352025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8362025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8372025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
8382025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8392025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
8402025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
8412025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8422025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
8432025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8442025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
8452025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
8462025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8472025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8482025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
8492025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8502025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
8512025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
8522025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8532025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8542025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
8552025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8562025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
8572025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8582025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
8592025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8602025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8612025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
8622025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8632025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8642025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8652025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8662025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8672025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8682025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8692025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8702025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8712025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8722025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8732025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8742025-01-02T23:45:34.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8752025-01-02T23:45:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8762025-01-02T23:45:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8772025-01-02T23:45:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8782025-01-02T23:45:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8792025-01-02T23:45:34.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802025-01-02T23:45:34.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8812025-01-02T23:45:34.426ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8822025-01-02T23:45:34.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8832025-01-02T23:45:34.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8842025-01-02T23:45:34.426ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.83659ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8852025-01-02T23:45:34.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8862025-01-02T23:45:34.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8872025-01-02T23:45:34.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8882025-01-02T23:45:34.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
8892025-01-02T23:45:34.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8902025-01-02T23:45:34.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8912025-01-02T23:45:34.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8922025-01-02T23:45:34.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8932025-01-02T23:45:34.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8942025-01-02T23:45:34.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952025-01-02T23:45:34.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962025-01-02T23:45:34.430ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8972025-01-02T23:45:34.430ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8982025-01-02T23:45:34.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8992025-01-02T23:45:34.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9002025-01-02T23:45:34.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 753127201 } })
9012025-01-02T23:45:34.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9022025-01-02T23:45:34.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9032025-01-02T23:45:34.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9042025-01-02T23:45:34.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9052025-01-02T23:45:34.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9062025-01-02T23:45:34.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9072025-01-02T23:45:34.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9082025-01-02T23:45:34.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 756541146 } })
9092025-01-02T23:45:34.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9102025-01-02T23:45:34.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.123503ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
9112025-01-02T23:45:34.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.605609ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9122025-01-02T23:45:34.437ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 758995578 } })
9132025-01-02T23:45:34.437ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
9142025-01-02T23:45:34.438ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9152025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9162025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9172025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9182025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9192025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9202025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9212025-01-02T23:45:34.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9222025-01-02T23:45:34.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9232025-01-02T23:45:34.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9242025-01-02T23:45:34.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9252025-01-02T23:45:34.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9262025-01-02T23:45:34.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9272025-01-02T23:45:34.462ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9282025-01-02T23:45:34.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9292025-01-02T23:45:34.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9302025-01-02T23:45:34.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312025-01-02T23:45:34.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9322025-01-02T23:45:34.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9332025-01-02T23:45:34.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9342025-01-02T23:45:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9352025-01-02T23:45:34.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9362025-01-02T23:45:34.468ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9372025-01-02T23:45:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9382025-01-02T23:45:34.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9392025-01-02T23:45:34.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9402025-01-02T23:45:34.469ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9412025-01-02T23:45:34.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9422025-01-02T23:45:34.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9432025-01-02T23:45:34.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.390735ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
9442025-01-02T23:45:34.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452025-01-02T23:45:34.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9462025-01-02T23:45:34.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9472025-01-02T23:45:34.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9482025-01-02T23:45:34.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9492025-01-02T23:45:34.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8a1161d7-6d62-4983-bc09-f43d060ae472, lookup_type: ById(8a1161d7-6d62-4983-bc09-f43d060ae472) } result = Ok(())
9502025-01-02T23:45:34.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9512025-01-02T23:45:34.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9522025-01-02T23:45:34.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.888061ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
9532025-01-02T23:45:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
9542025-01-02T23:45:34.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9552025-01-02T23:45:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9562025-01-02T23:45:34.479ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.904048ms iteration = 24 status = 0
9572025-01-02T23:45:34.482ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9582025-01-02T23:45:34.482ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9592025-01-02T23:45:34.482ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.196441ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9602025-01-02T23:45:34.487ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9612025-01-02T23:45:34.487ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.201607ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9622025-01-02T23:45:34.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9632025-01-02T23:45:34.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9642025-01-02T23:45:34.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.96075ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9652025-01-02T23:45:34.520ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 97.891797ms iteration = 27 status = {"physical_disks_added":0}
9662025-01-02T23:45:34.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9672025-01-02T23:45:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9682025-01-02T23:45:34.548ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a zone_address = fd00:1122:3344:101::2
9692025-01-02T23:45:34.548ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9702025-01-02T23:45:34.548ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c42cd3f-d889-45c1-8ca5-bfebdbf0fc44", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
9712025-01-02T23:45:34.548ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9722025-01-02T23:45:34.550ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
9732025-01-02T23:45:34.589ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9742025-01-02T23:45:34.589ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9752025-01-02T23:45:34.589ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a5922a0-4c7a-4609-b46d-153ef030655e", "content-length": "372", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
9762025-01-02T23:45:34.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9772025-01-02T23:45:34.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9782025-01-02T23:45:34.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
9792025-01-02T23:45:34.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 178.513687ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
9802025-01-02T23:45:34.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 205.629853ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9812025-01-02T23:45:34.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
9822025-01-02T23:45:34.644ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9832025-01-02T23:45:34.645ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "efb55704-2557-4318-82f9-4188cb5597ef", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
9842025-01-02T23:45:34.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9852025-01-02T23:45:34.645ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9862025-01-02T23:45:34.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9872025-01-02T23:45:34.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
9882025-01-02T23:45:34.645ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9892025-01-02T23:45:34.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f549621c-d961-4c67-bc24-4cf4edceb1f8", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
9902025-01-02T23:45:34.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9912025-01-02T23:45:34.645ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf092110-651f-4363-8dd5-a61646635aee", "content-length": "26", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
9922025-01-02T23:45:34.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9932025-01-02T23:45:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9942025-01-02T23:45:34.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9952025-01-02T23:45:34.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9962025-01-02T23:45:34.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9972025-01-02T23:45:34.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9982025-01-02T23:45:34.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9992025-01-02T23:45:34.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10002025-01-02T23:45:34.655ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10012025-01-02T23:45:34.655ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10022025-01-02T23:45:34.655ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6420dda8-ebd4-4657-885d-17fc6d1e454a", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10032025-01-02T23:45:34.658ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 236.066393ms iteration = 25 status = {}
10042025-01-02T23:45:34.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10052025-01-02T23:45:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10062025-01-02T23:45:34.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10072025-01-02T23:45:34.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10082025-01-02T23:45:34.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10092025-01-02T23:45:34.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10102025-01-02T23:45:34.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10112025-01-02T23:45:34.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10122025-01-02T23:45:34.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10132025-01-02T23:45:34.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10142025-01-02T23:45:34.745ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.434032ms iteration = 24 status = {}
10152025-01-02T23:45:34.748ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10162025-01-02T23:45:34.749ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "370ba731-d226-488f-8ece-4c0b0c8eb864", "content-length": "2", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10172025-01-02T23:45:34.751ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10182025-01-02T23:45:34.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10192025-01-02T23:45:34.753ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 330.859879ms iteration = 24 status = null
10202025-01-02T23:45:34.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10212025-01-02T23:45:34.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10222025-01-02T23:45:34.799ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 74b7adc4-e4eb-4c16-b1dc-cfb7bdc9491d, rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a88f93f1-cd0a-4937-aa27-b4266d8f17ee) } rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
10232025-01-02T23:45:34.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10242025-01-02T23:45:34.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10252025-01-02T23:45:34.809ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
10262025-01-02T23:45:34.809ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed1aade0-818f-40ff-8225-fcc851aa2a9a", "content-length": "134", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10272025-01-02T23:45:34.809ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
10282025-01-02T23:45:34.809ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a88f93f1-cd0a-4937-aa27-b4266d8f17ee
10292025-01-02T23:45:34.809ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10302025-01-02T23:45:34.809ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10312025-01-02T23:45:34.809ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10322025-01-02T23:45:34.809ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10332025-01-02T23:45:34.810ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10342025-01-02T23:45:34.810ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10352025-01-02T23:45:34.810ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10362025-01-02T23:45:34.810ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10372025-01-02T23:45:34.810ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
10382025-01-02T23:45:34.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10392025-01-02T23:45:34.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10402025-01-02T23:45:34.812ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10412025-01-02T23:45:34.812ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
10422025-01-02T23:45:34.812ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "72a11fd3-9f1a-4f7b-b9f3-9f2ccb49cfff", "content-length": "2", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10432025-01-02T23:45:34.812ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
10442025-01-02T23:45:34.812ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b21fc35-bea1-45da-bba4-9218ff563b52", "content-length": "52", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10452025-01-02T23:45:34.812ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
10462025-01-02T23:45:34.812ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10472025-01-02T23:45:34.813ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3f9c38d-6898-41bd-8aa9-fae2729ec741", "content-length": "691", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10482025-01-02T23:45:34.813ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
10492025-01-02T23:45:34.813ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
10502025-01-02T23:45:34.813ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
10512025-01-02T23:45:34.814ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 391.975823ms iteration = 25 status = {}
10522025-01-02T23:45:34.903ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7849d9a1-8b2d-41b5-911d-b5d95edaecd2", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10532025-01-02T23:45:34.903ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch = Switch0
10542025-01-02T23:45:34.903ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10552025-01-02T23:45:34.903ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f2f85b-3542-428d-a4de-566c46c4e8a1", "content-length": "682", "date": "Thu, 02 Jan 2025 23:45:34 GMT"} })
10562025-01-02T23:45:34.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10572025-01-02T23:45:34.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10582025-01-02T23:45:34.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10592025-01-02T23:45:34.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10602025-01-02T23:45:34.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10612025-01-02T23:45:34.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10622025-01-02T23:45:34.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10632025-01-02T23:45:34.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10642025-01-02T23:45:34.919ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 497.409618ms iteration = 24 status = {}
10652025-01-02T23:45:35.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1fa4198-9a3e-49d6-9cfd-dae1745b474a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10662025-01-02T23:45:35.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1fa4198-9a3e-49d6-9cfd-dae1745b474a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10672025-01-02T23:45:35.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1fa4198-9a3e-49d6-9cfd-dae1745b474a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10682025-01-02T23:45:36.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0d82662d-2ccd-4693-808d-2126f093db05 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10692025-01-02T23:45:36.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0d82662d-2ccd-4693-808d-2126f093db05 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10702025-01-02T23:45:36.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0d82662d-2ccd-4693-808d-2126f093db05 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10712025-01-02T23:45:37.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a75363b8-1f6c-41b2-9afe-1d08975f8cdb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10722025-01-02T23:45:37.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a75363b8-1f6c-41b2-9afe-1d08975f8cdb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10732025-01-02T23:45:37.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a75363b8-1f6c-41b2-9afe-1d08975f8cdb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10742025-01-02T23:45:38.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8c7795ec-d24b-4a22-8358-c813d21d0fa7 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10752025-01-02T23:45:38.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8c7795ec-d24b-4a22-8358-c813d21d0fa7 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10762025-01-02T23:45:38.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8c7795ec-d24b-4a22-8358-c813d21d0fa7 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10772025-01-02T23:45:39.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 46a5905a-a7c2-4137-ac2d-53575a5ce10a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10782025-01-02T23:45:39.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 46a5905a-a7c2-4137-ac2d-53575a5ce10a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10792025-01-02T23:45:39.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 46a5905a-a7c2-4137-ac2d-53575a5ce10a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10802025-01-02T23:45:40.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 786c7224-960b-49cb-a74d-584b93d356cd roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10812025-01-02T23:45:40.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 786c7224-960b-49cb-a74d-584b93d356cd resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10822025-01-02T23:45:40.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 786c7224-960b-49cb-a74d-584b93d356cd response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10832025-01-02T23:45:41.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1acd219b-d8b1-4a4f-a143-ffb7d96aa122 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10842025-01-02T23:45:41.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1acd219b-d8b1-4a4f-a143-ffb7d96aa122 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10852025-01-02T23:45:41.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1acd219b-d8b1-4a4f-a143-ffb7d96aa122 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10862025-01-02T23:45:42.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 24713e36-7431-4e67-ae15-1d04772cfefe roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10872025-01-02T23:45:42.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 24713e36-7431-4e67-ae15-1d04772cfefe resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10882025-01-02T23:45:42.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 24713e36-7431-4e67-ae15-1d04772cfefe response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10892025-01-02T23:45:43.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = af400082-d14b-4854-973e-31740a755cc4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10902025-01-02T23:45:43.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = af400082-d14b-4854-973e-31740a755cc4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10912025-01-02T23:45:43.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = af400082-d14b-4854-973e-31740a755cc4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10922025-01-02T23:45:43.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 3a4aad2e-8390-412f-aee6-d0bde22efcd9 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
10932025-01-02T23:45:44.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5718f28c-0283-4243-a42d-0c2c1b137c80 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10942025-01-02T23:45:44.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5718f28c-0283-4243-a42d-0c2c1b137c80 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10952025-01-02T23:45:44.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5718f28c-0283-4243-a42d-0c2c1b137c80 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
10962025-01-02T23:45:44.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
10972025-01-02T23:45:44.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
10982025-01-02T23:45:44.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10992025-01-02T23:45:44.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11002025-01-02T23:45:44.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11012025-01-02T23:45:44.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11022025-01-02T23:45:44.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11032025-01-02T23:45:44.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11042025-01-02T23:45:44.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052025-01-02T23:45:44.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.221446ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11062025-01-02T23:45:44.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11072025-01-02T23:45:44.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11082025-01-02T23:45:44.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11092025-01-02T23:45:44.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11102025-01-02T23:45:44.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11112025-01-02T23:45:44.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122025-01-02T23:45:44.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
11132025-01-02T23:45:44.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11142025-01-02T23:45:44.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11152025-01-02T23:45:44.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
11162025-01-02T23:45:44.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.995783ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
11172025-01-02T23:45:45.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0bf40a3c-26ef-4fad-aa2d-f2246bcfaa99 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11182025-01-02T23:45:45.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0bf40a3c-26ef-4fad-aa2d-f2246bcfaa99 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11192025-01-02T23:45:45.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0bf40a3c-26ef-4fad-aa2d-f2246bcfaa99 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11202025-01-02T23:45:46.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 64a4ddb4-d66d-44f8-8c4c-e4e68dd779e9 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11212025-01-02T23:45:46.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 64a4ddb4-d66d-44f8-8c4c-e4e68dd779e9 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11222025-01-02T23:45:46.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 64a4ddb4-d66d-44f8-8c4c-e4e68dd779e9 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11232025-01-02T23:45:47.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 36217af0-11ca-471a-a69c-eab225945380 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11242025-01-02T23:45:47.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 36217af0-11ca-471a-a69c-eab225945380 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11252025-01-02T23:45:47.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 36217af0-11ca-471a-a69c-eab225945380 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11262025-01-02T23:45:48.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ff6a4b4b-2dc4-45c8-b512-eeb87c17e3d1 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11272025-01-02T23:45:48.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ff6a4b4b-2dc4-45c8-b512-eeb87c17e3d1 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11282025-01-02T23:45:48.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ff6a4b4b-2dc4-45c8-b512-eeb87c17e3d1 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11292025-01-02T23:45:49.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 7ac5462e-3b0f-4ed3-a6a4-5907f9b0fc6a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11302025-01-02T23:45:49.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 7ac5462e-3b0f-4ed3-a6a4-5907f9b0fc6a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11312025-01-02T23:45:49.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 7ac5462e-3b0f-4ed3-a6a4-5907f9b0fc6a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11322025-01-02T23:45:50.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 99baecf6-75d6-4717-956e-4427241d1bc2 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11332025-01-02T23:45:50.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 99baecf6-75d6-4717-956e-4427241d1bc2 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11342025-01-02T23:45:50.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 99baecf6-75d6-4717-956e-4427241d1bc2 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11352025-01-02T23:45:51.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3a1cd3a3-7d98-4369-a73b-90ab0484f46c roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11362025-01-02T23:45:51.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3a1cd3a3-7d98-4369-a73b-90ab0484f46c resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11372025-01-02T23:45:51.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3a1cd3a3-7d98-4369-a73b-90ab0484f46c response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11382025-01-02T23:45:52.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 16f3a984-9596-4d6d-a9ca-33e39aabae6a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11392025-01-02T23:45:52.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 16f3a984-9596-4d6d-a9ca-33e39aabae6a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11402025-01-02T23:45:52.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 16f3a984-9596-4d6d-a9ca-33e39aabae6a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11412025-01-02T23:45:53.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = fd6f0460-c113-4e8b-ab71-02138f4b5b4d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11422025-01-02T23:45:53.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = fd6f0460-c113-4e8b-ab71-02138f4b5b4d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11432025-01-02T23:45:53.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = fd6f0460-c113-4e8b-ab71-02138f4b5b4d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11442025-01-02T23:45:53.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = e090ca28-d4be-4bc3-b58b-8a600a814e74 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
11452025-01-02T23:45:54.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
11462025-01-02T23:45:54.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11472025-01-02T23:45:54.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
11482025-01-02T23:45:54.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11492025-01-02T23:45:54.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11502025-01-02T23:45:54.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11512025-01-02T23:45:54.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11522025-01-02T23:45:54.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11532025-01-02T23:45:54.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11542025-01-02T23:45:54.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.035183ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11552025-01-02T23:45:54.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11562025-01-02T23:45:54.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11572025-01-02T23:45:54.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11582025-01-02T23:45:54.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11592025-01-02T23:45:54.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11602025-01-02T23:45:54.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612025-01-02T23:45:54.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
11622025-01-02T23:45:54.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11632025-01-02T23:45:54.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11642025-01-02T23:45:54.441ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
11652025-01-02T23:45:54.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.541847ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
11662025-01-02T23:45:54.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4ecdd455-5a64-41a7-a4c8-3aebd7447843 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11672025-01-02T23:45:54.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4ecdd455-5a64-41a7-a4c8-3aebd7447843 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11682025-01-02T23:45:54.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4ecdd455-5a64-41a7-a4c8-3aebd7447843 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11692025-01-02T23:45:55.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 51f40385-3940-40b8-aaa6-4d5ac5392799 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11702025-01-02T23:45:55.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 51f40385-3940-40b8-aaa6-4d5ac5392799 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11712025-01-02T23:45:55.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 51f40385-3940-40b8-aaa6-4d5ac5392799 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11722025-01-02T23:45:56.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8a015bac-8720-4c32-99cd-eb112430f543 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11732025-01-02T23:45:56.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8a015bac-8720-4c32-99cd-eb112430f543 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11742025-01-02T23:45:56.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8a015bac-8720-4c32-99cd-eb112430f543 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11752025-01-02T23:45:57.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 27ccaaaa-c7fa-4af6-b5b3-e53e6ce731d1 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11762025-01-02T23:45:57.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 27ccaaaa-c7fa-4af6-b5b3-e53e6ce731d1 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11772025-01-02T23:45:57.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 27ccaaaa-c7fa-4af6-b5b3-e53e6ce731d1 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11782025-01-02T23:45:58.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 041ad3ff-1576-4435-a88a-a637954e5f1d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11792025-01-02T23:45:58.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 041ad3ff-1576-4435-a88a-a637954e5f1d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11802025-01-02T23:45:58.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 041ad3ff-1576-4435-a88a-a637954e5f1d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11812025-01-02T23:45:59.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a252bda7-812d-4bda-9d93-e63907470c6b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11822025-01-02T23:45:59.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a252bda7-812d-4bda-9d93-e63907470c6b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11832025-01-02T23:45:59.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = a252bda7-812d-4bda-9d93-e63907470c6b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11842025-01-02T23:46:00.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9574307e-5779-412b-9f3c-35c8a67a424e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11852025-01-02T23:46:00.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9574307e-5779-412b-9f3c-35c8a67a424e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11862025-01-02T23:46:00.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9574307e-5779-412b-9f3c-35c8a67a424e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11872025-01-02T23:46:01.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d2381128-d0f0-4b03-9cea-48af76e2bc2a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11882025-01-02T23:46:01.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d2381128-d0f0-4b03-9cea-48af76e2bc2a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11892025-01-02T23:46:01.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d2381128-d0f0-4b03-9cea-48af76e2bc2a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11902025-01-02T23:46:02.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 91c1d0fd-ce59-4863-b11b-0bc164d47b29 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11912025-01-02T23:46:02.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 91c1d0fd-ce59-4863-b11b-0bc164d47b29 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11922025-01-02T23:46:02.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 91c1d0fd-ce59-4863-b11b-0bc164d47b29 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11932025-01-02T23:46:03.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = a2ed09f6-3153-4448-afa9-fdd4ea69df50 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
11942025-01-02T23:46:03.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3ef8ce17-dd4a-497c-83cb-8f3746525460 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11952025-01-02T23:46:03.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3ef8ce17-dd4a-497c-83cb-8f3746525460 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11962025-01-02T23:46:03.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3ef8ce17-dd4a-497c-83cb-8f3746525460 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
11972025-01-02T23:46:04.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
11982025-01-02T23:46:04.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
11992025-01-02T23:46:04.421ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
12002025-01-02T23:46:04.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12012025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12022025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
12032025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
12042025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12052025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
12062025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12072025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12082025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
12092025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
12102025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12112025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12122025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
12132025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12142025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
12152025-01-02T23:46:04.422ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = baf806d8-eb74-4256-91bc-030ba749ae9d
12162025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.92\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d"}
12172025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
12182025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
12192025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
12202025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12212025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12222025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12232025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
12242025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
12252025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12262025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
12272025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12282025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
12292025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12302025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
12312025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12322025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
12332025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12342025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
12352025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12362025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
12372025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12382025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12392025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12402025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
12412025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12422025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
12432025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
12442025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12452025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12462025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
12472025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12482025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
12492025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12502025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
12512025-01-02T23:46:04.422ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
12522025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12532025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
12542025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
12552025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
12562025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12572025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
12582025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
12592025-01-02T23:46:04.422ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12602025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12612025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
12622025-01-02T23:46:04.422ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-02 23:36:04.422858153 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
12632025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
12642025-01-02T23:46:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12652025-01-02T23:46:04.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21a27c6b-77bd-4944-8154-b74f56d79cee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edeee364-a24a-4b1f-a2f2-141a71f809d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edeee364-a24a-4b1f-a2f2-141a71f809d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 744277635 } })
12662025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12672025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12682025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12692025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12702025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12712025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12722025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12732025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12742025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12752025-01-02T23:46:04.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3cf11230-2b59-4cce-bb9f-d43f7cd85242.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cf07b438-4026-4d20-a0d8-212a50bca0d8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cf07b438-4026-4d20-a0d8-212a50bca0d8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 744528138 } })
12762025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12772025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12782025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12792025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12802025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12812025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12822025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12832025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12842025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12852025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12862025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12872025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12882025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
12892025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12902025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12912025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12922025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12932025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
12942025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.802704ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
12952025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12962025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12972025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
12982025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.053694ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
12992025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13002025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13012025-01-02T23:46:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13022025-01-02T23:46:04.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13032025-01-02T23:46:04.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13042025-01-02T23:46:04.426ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.191325ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
13052025-01-02T23:46:04.426ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.873341ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13062025-01-02T23:46:04.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13072025-01-02T23:46:04.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13082025-01-02T23:46:04.429ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13092025-01-02T23:46:04.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13102025-01-02T23:46:04.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13112025-01-02T23:46:04.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13122025-01-02T23:46:04.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132025-01-02T23:46:04.433ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13142025-01-02T23:46:04.433ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13152025-01-02T23:46:04.433ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13162025-01-02T23:46:04.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13172025-01-02T23:46:04.433ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13182025-01-02T23:46:04.433ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13192025-01-02T23:46:04.433ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.152886ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13202025-01-02T23:46:04.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13212025-01-02T23:46:04.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13222025-01-02T23:46:04.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13232025-01-02T23:46:04.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 756112230 } })
13242025-01-02T23:46:04.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
13252025-01-02T23:46:04.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13262025-01-02T23:46:04.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 756731709 } })
13272025-01-02T23:46:04.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
13282025-01-02T23:46:04.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13292025-01-02T23:46:04.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13302025-01-02T23:46:04.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13312025-01-02T23:46:04.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13322025-01-02T23:46:04.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13332025-01-02T23:46:04.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13342025-01-02T23:46:04.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13352025-01-02T23:46:04.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13362025-01-02T23:46:04.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13372025-01-02T23:46:04.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13382025-01-02T23:46:04.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392025-01-02T23:46:04.445ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-02 23:36:04.422858153 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
13402025-01-02T23:46:04.445ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.347973ms iteration = 13 status = {"expiration":"2025-01-02T23:36:04.422858153Z","pruned":[]}
13412025-01-02T23:46:04.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13422025-01-02T23:46:04.446ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13432025-01-02T23:46:04.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13442025-01-02T23:46:04.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13452025-01-02T23:46:04.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13462025-01-02T23:46:04.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13472025-01-02T23:46:04.450ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482025-01-02T23:46:04.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13492025-01-02T23:46:04.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13502025-01-02T23:46:04.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13512025-01-02T23:46:04.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13522025-01-02T23:46:04.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13532025-01-02T23:46:04.459ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13542025-01-02T23:46:04.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13552025-01-02T23:46:04.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13562025-01-02T23:46:04.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572025-01-02T23:46:04.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13582025-01-02T23:46:04.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13592025-01-02T23:46:04.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13602025-01-02T23:46:04.462ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.186698ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
13612025-01-02T23:46:04.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13622025-01-02T23:46:04.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13632025-01-02T23:46:04.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13642025-01-02T23:46:04.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13652025-01-02T23:46:04.463ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13662025-01-02T23:46:04.463ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.213982ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13672025-01-02T23:46:04.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13682025-01-02T23:46:04.466ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13692025-01-02T23:46:04.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13702025-01-02T23:46:04.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13712025-01-02T23:46:04.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13722025-01-02T23:46:04.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13732025-01-02T23:46:04.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13742025-01-02T23:46:04.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13752025-01-02T23:46:04.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.145187ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
13762025-01-02T23:46:04.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13772025-01-02T23:46:04.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13782025-01-02T23:46:04.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13792025-01-02T23:46:04.473ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13802025-01-02T23:46:04.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
13812025-01-02T23:46:04.476ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13822025-01-02T23:46:04.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13832025-01-02T23:46:04.479ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13842025-01-02T23:46:04.479ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13852025-01-02T23:46:04.479ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13862025-01-02T23:46:04.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13872025-01-02T23:46:04.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13882025-01-02T23:46:04.480ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892025-01-02T23:46:04.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13902025-01-02T23:46:04.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13912025-01-02T23:46:04.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13922025-01-02T23:46:04.481ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13932025-01-02T23:46:04.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13942025-01-02T23:46:04.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13952025-01-02T23:46:04.482ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13962025-01-02T23:46:04.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13972025-01-02T23:46:04.482ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982025-01-02T23:46:04.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.819939ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13992025-01-02T23:46:04.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14002025-01-02T23:46:04.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14012025-01-02T23:46:04.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14022025-01-02T23:46:04.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14032025-01-02T23:46:04.484ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14042025-01-02T23:46:04.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14052025-01-02T23:46:04.491ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14062025-01-02T23:46:04.491ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14072025-01-02T23:46:04.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14082025-01-02T23:46:04.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14092025-01-02T23:46:04.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14102025-01-02T23:46:04.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14112025-01-02T23:46:04.503ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14122025-01-02T23:46:04.503ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14132025-01-02T23:46:04.503ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14142025-01-02T23:46:04.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14152025-01-02T23:46:04.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14162025-01-02T23:46:04.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14172025-01-02T23:46:04.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14182025-01-02T23:46:04.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14192025-01-02T23:46:04.569ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14202025-01-02T23:46:04.569ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14212025-01-02T23:46:04.570ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf00a422-ff57-4520-a389-ab045c64f7a2", "content-length": "26", "date": "Thu, 02 Jan 2025 23:46:03 GMT"} })
14222025-01-02T23:46:04.570ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14232025-01-02T23:46:04.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14242025-01-02T23:46:04.571ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14252025-01-02T23:46:04.571ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e9658c-2acc-40b2-9b0e-a04bcc22390f", "content-length": "26", "date": "Thu, 02 Jan 2025 23:46:03 GMT"} })
14262025-01-02T23:46:04.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14272025-01-02T23:46:04.571ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14282025-01-02T23:46:04.573ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14292025-01-02T23:46:04.597ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14302025-01-02T23:46:04.686ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14312025-01-02T23:46:04.714ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14322025-01-02T23:46:04.714ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37836dfb-800f-4c3e-92c9-290e1212a59f", "content-length": "2", "date": "Thu, 02 Jan 2025 23:46:03 GMT"} })
14332025-01-02T23:46:04.715ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14342025-01-02T23:46:04.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14352025-01-02T23:46:04.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 46fdd488-6a59-4728-a391-cdfd9433530b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
14362025-01-02T23:46:04.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 46fdd488-6a59-4728-a391-cdfd9433530b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
14372025-01-02T23:46:04.810ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14382025-01-02T23:46:04.810ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14392025-01-02T23:46:04.811ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac3e7863-9377-4a97-8ecb-f0242c1421ef", "content-length": "372", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
14402025-01-02T23:46:04.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14412025-01-02T23:46:04.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14422025-01-02T23:46:04.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14432025-01-02T23:46:04.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14442025-01-02T23:46:04.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14452025-01-02T23:46:04.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14462025-01-02T23:46:04.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14472025-01-02T23:46:04.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14482025-01-02T23:46:04.817ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a1d60155-13cc-42ac-b33e-ff228fe81303", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14492025-01-02T23:46:04.817ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14502025-01-02T23:46:04.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14512025-01-02T23:46:04.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14522025-01-02T23:46:04.819ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "176ef008-5caf-4811-b74a-b523c0c08fac", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14532025-01-02T23:46:04.819ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14542025-01-02T23:46:04.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14552025-01-02T23:46:04.820ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7f09208d-9586-4d1b-b225-7743d4abc4ee", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14562025-01-02T23:46:04.820ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14572025-01-02T23:46:04.820ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1686, tv_nsec: 142137745 } })
14582025-01-02T23:46:04.821ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 398.573048ms iteration = 6 status = {"nsuccess":5}
14592025-01-02T23:46:04.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
14602025-01-02T23:46:04.824ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 401.556228ms iteration = 25 status = null
14612025-01-02T23:46:04.824ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14622025-01-02T23:46:04.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 401.471667ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14632025-01-02T23:46:04.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 46fdd488-6a59-4728-a391-cdfd9433530b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
14642025-01-02T23:46:04.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14652025-01-02T23:46:04.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14662025-01-02T23:46:04.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14672025-01-02T23:46:04.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14682025-01-02T23:46:04.852ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14692025-01-02T23:46:04.852ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14702025-01-02T23:46:04.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 429.662128ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14712025-01-02T23:46:04.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14722025-01-02T23:46:04.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14732025-01-02T23:46:04.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742025-01-02T23:46:04.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14752025-01-02T23:46:04.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762025-01-02T23:46:04.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14772025-01-02T23:46:04.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14782025-01-02T23:46:04.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14792025-01-02T23:46:04.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14802025-01-02T23:46:04.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14812025-01-02T23:46:04.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14822025-01-02T23:46:04.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14832025-01-02T23:46:04.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14842025-01-02T23:46:04.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 436.7084ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14852025-01-02T23:46:04.859ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14862025-01-02T23:46:04.859ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14872025-01-02T23:46:04.859ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 436.832382ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14882025-01-02T23:46:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8a1161d7-6d62-4983-bc09-f43d060ae472, lookup_type: ById(8a1161d7-6d62-4983-bc09-f43d060ae472) } result = Ok(())
14892025-01-02T23:46:04.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14902025-01-02T23:46:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14912025-01-02T23:46:04.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 437.4604ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14922025-01-02T23:46:04.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932025-01-02T23:46:04.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14942025-01-02T23:46:04.862ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 439.942013ms iteration = 25 status = 0
14952025-01-02T23:46:04.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
14962025-01-02T23:46:04.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14972025-01-02T23:46:04.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14982025-01-02T23:46:04.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14992025-01-02T23:46:04.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15002025-01-02T23:46:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15012025-01-02T23:46:04.865ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15022025-01-02T23:46:04.865ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 074636c4-f52c-4c82-954e-efd9d4812db6 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15032025-01-02T23:46:04.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15042025-01-02T23:46:04.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15052025-01-02T23:46:04.877ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
15062025-01-02T23:46:04.877ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15072025-01-02T23:46:04.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8a4605d5-d5f1-44fe-9648-c6e480c1d7d0", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15082025-01-02T23:46:04.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15092025-01-02T23:46:04.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15102025-01-02T23:46:04.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15112025-01-02T23:46:04.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
15122025-01-02T23:46:04.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 458.79843ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
15132025-01-02T23:46:04.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15142025-01-02T23:46:04.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 461.041379ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15152025-01-02T23:46:04.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15162025-01-02T23:46:04.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15172025-01-02T23:46:04.891ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15182025-01-02T23:46:04.891ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15192025-01-02T23:46:04.892ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0aa74714-a0ec-4e17-890e-27fb3c28a460", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15202025-01-02T23:46:04.894ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 472.002824ms iteration = 26 status = {}
15212025-01-02T23:46:04.896ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 473.547314ms iteration = 25 status = {}
15222025-01-02T23:46:04.898ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15232025-01-02T23:46:04.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15242025-01-02T23:46:04.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8acf58e3-3e25-48be-bcb1-24e5a6779a14", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15252025-01-02T23:46:04.898ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15262025-01-02T23:46:04.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "199fdfdb-2cb4-44a6-a383-4f2244cc624d", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15272025-01-02T23:46:04.900ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15282025-01-02T23:46:04.900ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15292025-01-02T23:46:04.900ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a8c4f8d-ef7b-4396-aa86-4770ac83fa25 dns_zone_name = oxide.test found_so_far = 0 version = 2
15302025-01-02T23:46:04.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15312025-01-02T23:46:04.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15322025-01-02T23:46:04.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15332025-01-02T23:46:04.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15342025-01-02T23:46:04.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15352025-01-02T23:46:04.902ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15362025-01-02T23:46:04.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 479.273829ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15372025-01-02T23:46:04.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15382025-01-02T23:46:04.903ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-02T23:33:58.545542Z, time_modified: 2025-01-02T23:33:58.545542Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, db_silo: Silo { identity: SiloIdentity { id: 31564a6d-adef-486f-8af0-44d369c942f7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-02T23:34:09.297095Z, time_modified: 2025-01-02T23:34:09.297095Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, db_silo: Silo { identity: SiloIdentity { id: 31564a6d-adef-486f-8af0-44d369c942f7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-02T23:34:09.297095Z, time_modified: 2025-01-02T23:34:09.297095Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f" }] }) }
15392025-01-02T23:46:04.903ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 481.182284ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"31564a6d-adef-486f-8af0-44d369c942f7","tls_certs":["57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f"]}},"default_endpoint":{"silo_id":"31564a6d-adef-486f-8af0-44d369c942f7","tls_certs":["57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15402025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 074636c4-f52c-4c82-954e-efd9d4812db6 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15412025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15422025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-02 23:34:06.342386 UTC dns_group = internal generation = 1
15432025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 482.280249ms iteration = 13 status = {"generation":1}
15442025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15452025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15462025-01-02T23:46:04.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15472025-01-02T23:46:04.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a zone_address = fd00:1122:3344:101::2
15482025-01-02T23:46:04.906ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15492025-01-02T23:46:04.906ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a8c4f8d-ef7b-4396-aa86-4770ac83fa25 dns_zone_name = oxide.test found_so_far = 1 version = 2
15502025-01-02T23:46:04.906ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15512025-01-02T23:46:04.906ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-02 23:34:09.381030 UTC dns_group = external generation = 2
15522025-01-02T23:46:04.906ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 483.944571ms iteration = 13 status = {"generation":2}
15532025-01-02T23:46:04.906ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b51aa9f4-5e60-4d1c-ab30-c77585224a30", "content-length": "26", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15542025-01-02T23:46:04.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15552025-01-02T23:46:04.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
15562025-01-02T23:46:04.925ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
15572025-01-02T23:46:04.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 502.827719ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15582025-01-02T23:46:04.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15592025-01-02T23:46:04.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15602025-01-02T23:46:04.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612025-01-02T23:46:04.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15622025-01-02T23:46:04.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15632025-01-02T23:46:04.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15642025-01-02T23:46:04.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652025-01-02T23:46:04.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15662025-01-02T23:46:04.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15672025-01-02T23:46:04.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15682025-01-02T23:46:04.962ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 539.887056ms iteration = 28 status = {"physical_disks_added":0}
15692025-01-02T23:46:05.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15702025-01-02T23:46:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15712025-01-02T23:46:05.004ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 74b7adc4-e4eb-4c16-b1dc-cfb7bdc9491d, rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a88f93f1-cd0a-4937-aa27-b4266d8f17ee) } rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
15722025-01-02T23:46:05.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15732025-01-02T23:46:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15742025-01-02T23:46:05.014ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15752025-01-02T23:46:05.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa99197b-f186-4c77-8128-49526c6f8ff2", "content-length": "134", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15762025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15772025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a88f93f1-cd0a-4937-aa27-b4266d8f17ee
15782025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15792025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15802025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15812025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15822025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15832025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15842025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15852025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15862025-01-02T23:46:05.015ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
15872025-01-02T23:46:05.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15882025-01-02T23:46:05.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15892025-01-02T23:46:05.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15902025-01-02T23:46:05.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d3f9c2e-2538-444a-bff6-60858f2b1397", "content-length": "2", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15912025-01-02T23:46:05.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15922025-01-02T23:46:05.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e371156-cd78-4131-bf7d-9950430085a8", "content-length": "52", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15932025-01-02T23:46:05.018ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
15942025-01-02T23:46:05.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15952025-01-02T23:46:05.023ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15962025-01-02T23:46:05.108ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1349f1ad-b772-4c42-ab31-acff7f2f7cd7", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
15972025-01-02T23:46:05.108ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch = Switch0
15982025-01-02T23:46:05.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15992025-01-02T23:46:05.108ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd6b11dc-1a49-405e-bfe3-f66832820f13", "content-length": "691", "date": "Thu, 02 Jan 2025 23:46:04 GMT"} })
16002025-01-02T23:46:05.108ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16012025-01-02T23:46:05.108ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16022025-01-02T23:46:05.108ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16032025-01-02T23:46:05.108ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0c9fc62-5ebd-4c0f-a042-cccd49c70181", "content-length": "682", "date": "Thu, 02 Jan 2025 23:46:05 GMT"} })
16042025-01-02T23:46:05.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16052025-01-02T23:46:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16062025-01-02T23:46:05.109ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 687.00616ms iteration = 26 status = {}
16072025-01-02T23:46:05.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16082025-01-02T23:46:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16092025-01-02T23:46:05.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16102025-01-02T23:46:05.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16112025-01-02T23:46:05.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16122025-01-02T23:46:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16132025-01-02T23:46:05.125ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.393252ms iteration = 25 status = {}
16142025-01-02T23:46:05.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 84b471e4-eae6-433b-8b54-a29a22aef262 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16152025-01-02T23:46:05.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 84b471e4-eae6-433b-8b54-a29a22aef262 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16162025-01-02T23:46:05.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 84b471e4-eae6-433b-8b54-a29a22aef262 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16172025-01-02T23:46:06.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 189b9dd7-dc53-415e-98f8-07c5a80c0be3 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16182025-01-02T23:46:06.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 189b9dd7-dc53-415e-98f8-07c5a80c0be3 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16192025-01-02T23:46:06.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 189b9dd7-dc53-415e-98f8-07c5a80c0be3 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16202025-01-02T23:46:07.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 17e7a75d-164e-4d07-99cf-156f7729ba0a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16212025-01-02T23:46:07.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 17e7a75d-164e-4d07-99cf-156f7729ba0a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16222025-01-02T23:46:07.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 17e7a75d-164e-4d07-99cf-156f7729ba0a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16232025-01-02T23:46:08.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 58bf6433-35f4-45f4-bd42-636289c86b5a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16242025-01-02T23:46:08.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 58bf6433-35f4-45f4-bd42-636289c86b5a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16252025-01-02T23:46:08.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 58bf6433-35f4-45f4-bd42-636289c86b5a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16262025-01-02T23:46:09.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c2198c1e-ad83-410f-8287-6ae6d5bfb949 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16272025-01-02T23:46:09.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c2198c1e-ad83-410f-8287-6ae6d5bfb949 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16282025-01-02T23:46:09.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c2198c1e-ad83-410f-8287-6ae6d5bfb949 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16292025-01-02T23:46:10.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 30d6f684-67b0-4684-8528-b5c48c368642 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16302025-01-02T23:46:10.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 30d6f684-67b0-4684-8528-b5c48c368642 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16312025-01-02T23:46:10.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 30d6f684-67b0-4684-8528-b5c48c368642 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16322025-01-02T23:46:11.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cab631f1-7e40-417a-aa07-0cdb0f81cb8d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16332025-01-02T23:46:11.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cab631f1-7e40-417a-aa07-0cdb0f81cb8d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16342025-01-02T23:46:11.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cab631f1-7e40-417a-aa07-0cdb0f81cb8d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16352025-01-02T23:46:13.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1c93289e-731b-47dc-8385-9749ce2f1ef1 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16362025-01-02T23:46:13.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1c93289e-731b-47dc-8385-9749ce2f1ef1 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16372025-01-02T23:46:13.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1c93289e-731b-47dc-8385-9749ce2f1ef1 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16382025-01-02T23:46:13.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 590 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 18199920-9aad-4398-8bf3-ea13b316f7d5 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
16392025-01-02T23:46:14.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4c502b97-f71b-4ff8-8721-dccd46cc589e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16402025-01-02T23:46:14.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4c502b97-f71b-4ff8-8721-dccd46cc589e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16412025-01-02T23:46:14.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4c502b97-f71b-4ff8-8721-dccd46cc589e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16422025-01-02T23:46:14.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
16432025-01-02T23:46:14.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16442025-01-02T23:46:14.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
16452025-01-02T23:46:14.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16462025-01-02T23:46:14.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16472025-01-02T23:46:14.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16482025-01-02T23:46:14.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492025-01-02T23:46:14.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16502025-01-02T23:46:14.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16512025-01-02T23:46:14.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16522025-01-02T23:46:14.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16532025-01-02T23:46:14.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16542025-01-02T23:46:14.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552025-01-02T23:46:14.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
16562025-01-02T23:46:14.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16572025-01-02T23:46:14.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16582025-01-02T23:46:14.444ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
16592025-01-02T23:46:14.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.806166ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
16602025-01-02T23:46:14.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16612025-01-02T23:46:14.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16622025-01-02T23:46:14.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.740598ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16632025-01-02T23:46:15.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8f5dc850-83ba-487a-87fd-5861580f3942 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16642025-01-02T23:46:15.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8f5dc850-83ba-487a-87fd-5861580f3942 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16652025-01-02T23:46:15.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8f5dc850-83ba-487a-87fd-5861580f3942 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16662025-01-02T23:46:16.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1140468-400d-4b63-b847-c3cf0e82eceb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16672025-01-02T23:46:16.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1140468-400d-4b63-b847-c3cf0e82eceb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16682025-01-02T23:46:16.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1140468-400d-4b63-b847-c3cf0e82eceb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16692025-01-02T23:46:17.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 94ff17c7-28f8-4dd4-a46b-0ef531ab5ead roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16702025-01-02T23:46:17.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 94ff17c7-28f8-4dd4-a46b-0ef531ab5ead resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16712025-01-02T23:46:17.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 94ff17c7-28f8-4dd4-a46b-0ef531ab5ead response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16722025-01-02T23:46:18.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f7b0976d-73b7-4e8d-b713-434a8e74bfc7 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16732025-01-02T23:46:18.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f7b0976d-73b7-4e8d-b713-434a8e74bfc7 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16742025-01-02T23:46:18.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f7b0976d-73b7-4e8d-b713-434a8e74bfc7 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16752025-01-02T23:46:19.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cd51edd2-712a-4f2a-bd81-2b55be77dab4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16762025-01-02T23:46:19.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cd51edd2-712a-4f2a-bd81-2b55be77dab4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16772025-01-02T23:46:19.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cd51edd2-712a-4f2a-bd81-2b55be77dab4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16782025-01-02T23:46:20.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 77445b02-92a2-48ea-9f17-b793ff039f17 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16792025-01-02T23:46:20.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 77445b02-92a2-48ea-9f17-b793ff039f17 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16802025-01-02T23:46:20.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 77445b02-92a2-48ea-9f17-b793ff039f17 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16812025-01-02T23:46:21.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 12999134-8294-46d6-ae60-a86a46e947b4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16822025-01-02T23:46:21.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 12999134-8294-46d6-ae60-a86a46e947b4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16832025-01-02T23:46:21.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 12999134-8294-46d6-ae60-a86a46e947b4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16842025-01-02T23:46:22.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b425d478-08d0-4ac3-95c9-6c2f2f206300 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16852025-01-02T23:46:22.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b425d478-08d0-4ac3-95c9-6c2f2f206300 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16862025-01-02T23:46:22.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b425d478-08d0-4ac3-95c9-6c2f2f206300 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16872025-01-02T23:46:23.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e8c85ccb-cad7-472e-87bc-ee2b60493ceb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16882025-01-02T23:46:23.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e8c85ccb-cad7-472e-87bc-ee2b60493ceb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16892025-01-02T23:46:23.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e8c85ccb-cad7-472e-87bc-ee2b60493ceb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16902025-01-02T23:46:23.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 2a55fd2b-7805-476f-9952-edac480ae8b2 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
16912025-01-02T23:46:24.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 84acdca8-224f-4eae-be5e-8c288fd4d21c roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16922025-01-02T23:46:24.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 84acdca8-224f-4eae-be5e-8c288fd4d21c resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16932025-01-02T23:46:24.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 84acdca8-224f-4eae-be5e-8c288fd4d21c response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
16942025-01-02T23:46:24.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
16952025-01-02T23:46:24.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16962025-01-02T23:46:24.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
16972025-01-02T23:46:24.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16982025-01-02T23:46:24.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16992025-01-02T23:46:24.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17002025-01-02T23:46:24.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012025-01-02T23:46:24.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17022025-01-02T23:46:24.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17032025-01-02T23:46:24.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17042025-01-02T23:46:24.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17052025-01-02T23:46:24.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17062025-01-02T23:46:24.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072025-01-02T23:46:24.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
17082025-01-02T23:46:24.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17092025-01-02T23:46:24.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17102025-01-02T23:46:24.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
17112025-01-02T23:46:24.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.197242ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
17122025-01-02T23:46:24.458ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17132025-01-02T23:46:24.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17142025-01-02T23:46:24.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.792557ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17152025-01-02T23:46:25.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ce02a9a4-fd28-410f-b68d-c6aed844ff7f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17162025-01-02T23:46:25.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ce02a9a4-fd28-410f-b68d-c6aed844ff7f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17172025-01-02T23:46:25.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ce02a9a4-fd28-410f-b68d-c6aed844ff7f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17182025-01-02T23:46:26.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 671c980b-bb42-4c4c-afb1-0a4e09298263 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17192025-01-02T23:46:26.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 671c980b-bb42-4c4c-afb1-0a4e09298263 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17202025-01-02T23:46:26.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 671c980b-bb42-4c4c-afb1-0a4e09298263 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17212025-01-02T23:46:27.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c4b524fa-3eb1-43df-9642-f6c4c018d14c roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17222025-01-02T23:46:27.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c4b524fa-3eb1-43df-9642-f6c4c018d14c resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17232025-01-02T23:46:27.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c4b524fa-3eb1-43df-9642-f6c4c018d14c response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17242025-01-02T23:46:28.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1dc6545d-17d4-4c79-a83b-d24329481a18 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17252025-01-02T23:46:28.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1dc6545d-17d4-4c79-a83b-d24329481a18 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17262025-01-02T23:46:28.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1dc6545d-17d4-4c79-a83b-d24329481a18 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17272025-01-02T23:46:29.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f49c926b-ccf2-4296-9de3-b447659c9a5f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17282025-01-02T23:46:29.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f49c926b-ccf2-4296-9de3-b447659c9a5f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17292025-01-02T23:46:29.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f49c926b-ccf2-4296-9de3-b447659c9a5f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17302025-01-02T23:46:30.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 36aca0a1-32b4-4afc-8e4e-9e456bc7f47c roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17312025-01-02T23:46:30.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 36aca0a1-32b4-4afc-8e4e-9e456bc7f47c resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17322025-01-02T23:46:30.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 36aca0a1-32b4-4afc-8e4e-9e456bc7f47c response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17332025-01-02T23:46:31.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 75376805-a46e-4258-844b-f61b8cd11a09 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17342025-01-02T23:46:31.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 75376805-a46e-4258-844b-f61b8cd11a09 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17352025-01-02T23:46:31.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 75376805-a46e-4258-844b-f61b8cd11a09 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17362025-01-02T23:46:32.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1e7e5e7-0607-40bf-91fb-6d19357abf2e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17372025-01-02T23:46:32.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1e7e5e7-0607-40bf-91fb-6d19357abf2e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17382025-01-02T23:46:32.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1e7e5e7-0607-40bf-91fb-6d19357abf2e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17392025-01-02T23:46:33.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d87b5977-cc75-4040-bf77-7e9ebbb78aed roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17402025-01-02T23:46:33.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d87b5977-cc75-4040-bf77-7e9ebbb78aed resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17412025-01-02T23:46:33.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d87b5977-cc75-4040-bf77-7e9ebbb78aed response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
17422025-01-02T23:46:33.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 475 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 19a25ac4-37e9-49fa-82b9-4d33b35e4aba response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
17432025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
17442025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
17452025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17462025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17472025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
17482025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
17492025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17502025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17512025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
17522025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17532025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
17542025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17552025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
17562025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17572025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
17582025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17592025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
17602025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17612025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
17622025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
17632025-01-02T23:46:34.423ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17642025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17652025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17662025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
17672025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
17682025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17692025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
17702025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17712025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17722025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
17732025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
17742025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
17752025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17762025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17772025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17782025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17792025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17802025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17812025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17822025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17832025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17842025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17852025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17862025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17872025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17882025-01-02T23:46:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17892025-01-02T23:46:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17902025-01-02T23:46:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17912025-01-02T23:46:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17922025-01-02T23:46:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17932025-01-02T23:46:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17942025-01-02T23:46:34.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952025-01-02T23:46:34.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962025-01-02T23:46:34.427ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.776369ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17972025-01-02T23:46:34.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17982025-01-02T23:46:34.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17992025-01-02T23:46:34.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18002025-01-02T23:46:34.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18012025-01-02T23:46:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18022025-01-02T23:46:34.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18032025-01-02T23:46:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18042025-01-02T23:46:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18052025-01-02T23:46:34.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18062025-01-02T23:46:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18072025-01-02T23:46:34.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.980162ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
18082025-01-02T23:46:34.430ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1715, tv_nsec: 751385438 } })
18092025-01-02T23:46:34.430ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18102025-01-02T23:46:34.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18112025-01-02T23:46:34.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.035879ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
18122025-01-02T23:46:34.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18132025-01-02T23:46:34.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18142025-01-02T23:46:34.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18152025-01-02T23:46:34.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162025-01-02T23:46:34.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172025-01-02T23:46:34.439ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1715, tv_nsec: 760668890 } })
18182025-01-02T23:46:34.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18192025-01-02T23:46:34.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18202025-01-02T23:46:34.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18212025-01-02T23:46:34.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18222025-01-02T23:46:34.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18232025-01-02T23:46:34.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18242025-01-02T23:46:34.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1715, tv_nsec: 763252784 } })
18252025-01-02T23:46:34.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18262025-01-02T23:46:34.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18272025-01-02T23:46:34.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
18282025-01-02T23:46:34.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18292025-01-02T23:46:34.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18302025-01-02T23:46:34.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18312025-01-02T23:46:34.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18322025-01-02T23:46:34.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18332025-01-02T23:46:34.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18342025-01-02T23:46:34.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18352025-01-02T23:46:34.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18362025-01-02T23:46:34.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18372025-01-02T23:46:34.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18382025-01-02T23:46:34.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18392025-01-02T23:46:34.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18402025-01-02T23:46:34.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
18412025-01-02T23:46:34.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18422025-01-02T23:46:34.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18432025-01-02T23:46:34.458ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18442025-01-02T23:46:34.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18452025-01-02T23:46:34.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.179249ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18462025-01-02T23:46:34.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
18472025-01-02T23:46:34.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.526216ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
18482025-01-02T23:46:34.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f84eef9f-db9a-4faa-a117-0c1ead281b8b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
18492025-01-02T23:46:34.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f84eef9f-db9a-4faa-a117-0c1ead281b8b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
18502025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18512025-01-02T23:46:34.465ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18522025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18532025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18542025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18552025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18562025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18572025-01-02T23:46:34.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18582025-01-02T23:46:34.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18592025-01-02T23:46:34.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f84eef9f-db9a-4faa-a117-0c1ead281b8b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
18602025-01-02T23:46:34.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18612025-01-02T23:46:34.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.476725ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18622025-01-02T23:46:34.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 44.490695ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18632025-01-02T23:46:34.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18642025-01-02T23:46:34.468ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18652025-01-02T23:46:34.468ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18662025-01-02T23:46:34.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18672025-01-02T23:46:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18682025-01-02T23:46:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18692025-01-02T23:46:34.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18702025-01-02T23:46:34.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18712025-01-02T23:46:34.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722025-01-02T23:46:34.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732025-01-02T23:46:34.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18742025-01-02T23:46:34.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18752025-01-02T23:46:34.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18762025-01-02T23:46:34.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8a1161d7-6d62-4983-bc09-f43d060ae472, lookup_type: ById(8a1161d7-6d62-4983-bc09-f43d060ae472) } result = Ok(())
18772025-01-02T23:46:34.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18782025-01-02T23:46:34.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18792025-01-02T23:46:34.475ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18802025-01-02T23:46:34.475ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.922573ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18812025-01-02T23:46:34.476ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.050988ms iteration = 26 status = 0
18822025-01-02T23:46:34.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18832025-01-02T23:46:34.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18842025-01-02T23:46:34.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852025-01-02T23:46:34.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18862025-01-02T23:46:34.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18872025-01-02T23:46:34.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18882025-01-02T23:46:34.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18892025-01-02T23:46:34.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18902025-01-02T23:46:34.507ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18912025-01-02T23:46:34.507ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18922025-01-02T23:46:34.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.323959ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18932025-01-02T23:46:34.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18942025-01-02T23:46:34.520ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18952025-01-02T23:46:34.520ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a483f400-e021-43bb-abe8-c5aa61dfaf41", "content-length": "26", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
18962025-01-02T23:46:34.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18972025-01-02T23:46:34.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18982025-01-02T23:46:34.537ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18992025-01-02T23:46:34.537ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19002025-01-02T23:46:34.537ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ec1c800-d209-4211-8970-b30f8a2e31b8", "content-length": "26", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19012025-01-02T23:46:34.537ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19022025-01-02T23:46:34.539ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19032025-01-02T23:46:34.541ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.762791ms iteration = 29 status = {"physical_disks_added":0}
19042025-01-02T23:46:34.546ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a zone_address = fd00:1122:3344:101::2
19052025-01-02T23:46:34.546ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19062025-01-02T23:46:34.546ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ea7d9dc-72de-4e78-b749-21ad1954de77", "content-length": "26", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19072025-01-02T23:46:34.546ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19082025-01-02T23:46:34.548ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
19092025-01-02T23:46:34.581ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19102025-01-02T23:46:34.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19112025-01-02T23:46:34.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec088282-1479-4b8b-ae37-427939233efd", "content-length": "372", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19122025-01-02T23:46:34.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19132025-01-02T23:46:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19142025-01-02T23:46:34.598ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19152025-01-02T23:46:34.598ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19162025-01-02T23:46:34.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5dc8f48b-ce8c-461e-acc2-fd1dd52a4e64", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19172025-01-02T23:46:34.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19182025-01-02T23:46:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19192025-01-02T23:46:34.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19202025-01-02T23:46:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19212025-01-02T23:46:34.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19222025-01-02T23:46:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19232025-01-02T23:46:34.608ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19242025-01-02T23:46:34.608ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19252025-01-02T23:46:34.609ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b6f1b58-4c7a-4328-821d-a064149816cd", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19262025-01-02T23:46:34.611ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 188.320435ms iteration = 27 status = {}
19272025-01-02T23:46:34.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282025-01-02T23:46:34.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 194.375195ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19292025-01-02T23:46:34.618ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19302025-01-02T23:46:34.618ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0ea29ea-7058-4ba3-9c35-92e8748c8a15", "content-length": "2", "date": "Thu, 02 Jan 2025 23:46:33 GMT"} })
19312025-01-02T23:46:34.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19322025-01-02T23:46:34.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19332025-01-02T23:46:34.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19342025-01-02T23:46:34.620ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19352025-01-02T23:46:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19362025-01-02T23:46:34.621ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.615791ms iteration = 26 status = null
19372025-01-02T23:46:34.625ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.734012ms iteration = 26 status = {}
19382025-01-02T23:46:34.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19392025-01-02T23:46:34.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19402025-01-02T23:46:34.697ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 74b7adc4-e4eb-4c16-b1dc-cfb7bdc9491d, rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a88f93f1-cd0a-4937-aa27-b4266d8f17ee) } rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
19412025-01-02T23:46:34.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19422025-01-02T23:46:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19432025-01-02T23:46:34.707ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19442025-01-02T23:46:34.707ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "872ffd36-7df8-4291-b8d2-a15932eed9fd", "content-length": "134", "date": "Thu, 02 Jan 2025 23:46:33 GMT"} })
19452025-01-02T23:46:34.707ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
19462025-01-02T23:46:34.707ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a88f93f1-cd0a-4937-aa27-b4266d8f17ee
19472025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
19482025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19492025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19502025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19512025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19522025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19532025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19542025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19552025-01-02T23:46:34.708ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
19562025-01-02T23:46:34.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19572025-01-02T23:46:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19582025-01-02T23:46:34.709ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19592025-01-02T23:46:34.709ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca143bd1-eb83-41ca-b1da-1f9692c4de1c", "content-length": "691", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19602025-01-02T23:46:34.709ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19612025-01-02T23:46:34.709ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19622025-01-02T23:46:34.709ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19632025-01-02T23:46:34.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19642025-01-02T23:46:34.710ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bea6cdf-b1eb-4c53-bc37-12593037fa0d", "content-length": "2", "date": "Thu, 02 Jan 2025 23:46:33 GMT"} })
19652025-01-02T23:46:34.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19662025-01-02T23:46:34.710ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9cdebdc-9560-492c-b032-fe549c0a447b", "content-length": "52", "date": "Thu, 02 Jan 2025 23:46:33 GMT"} })
19672025-01-02T23:46:34.710ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
19682025-01-02T23:46:34.710ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19692025-01-02T23:46:34.712ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 288.698614ms iteration = 27 status = {}
19702025-01-02T23:46:34.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5370f106-f224-4106-9171-63eb0e532d0a", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19712025-01-02T23:46:34.802ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch = Switch0
19722025-01-02T23:46:34.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19732025-01-02T23:46:34.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "493140e2-26cf-46ab-adf9-80e44f2d506d", "content-length": "682", "date": "Thu, 02 Jan 2025 23:46:34 GMT"} })
19742025-01-02T23:46:34.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19752025-01-02T23:46:34.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19762025-01-02T23:46:34.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19772025-01-02T23:46:34.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19782025-01-02T23:46:34.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19792025-01-02T23:46:34.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19802025-01-02T23:46:34.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19812025-01-02T23:46:34.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19822025-01-02T23:46:34.819ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 395.978485ms iteration = 26 status = {}
19832025-01-02T23:46:35.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = aa439c68-1eb9-492b-bbdf-339b4f319281 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19842025-01-02T23:46:35.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = aa439c68-1eb9-492b-bbdf-339b4f319281 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19852025-01-02T23:46:35.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = aa439c68-1eb9-492b-bbdf-339b4f319281 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19862025-01-02T23:46:36.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 01f524d6-ab5e-48b6-8f60-1fa2c7c7b759 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19872025-01-02T23:46:36.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 01f524d6-ab5e-48b6-8f60-1fa2c7c7b759 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19882025-01-02T23:46:36.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 01f524d6-ab5e-48b6-8f60-1fa2c7c7b759 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19892025-01-02T23:46:37.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f06dd9a5-8fd6-4f1d-8ccb-d6462130cdd6 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19902025-01-02T23:46:37.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f06dd9a5-8fd6-4f1d-8ccb-d6462130cdd6 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19912025-01-02T23:46:37.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f06dd9a5-8fd6-4f1d-8ccb-d6462130cdd6 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19922025-01-02T23:46:38.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 11b50428-fc18-442c-9398-8600f3752187 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19932025-01-02T23:46:38.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 11b50428-fc18-442c-9398-8600f3752187 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19942025-01-02T23:46:38.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 11b50428-fc18-442c-9398-8600f3752187 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19952025-01-02T23:46:39.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6f46aaab-42e7-43ee-8a7f-5b8a6a499b88 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19962025-01-02T23:46:39.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6f46aaab-42e7-43ee-8a7f-5b8a6a499b88 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19972025-01-02T23:46:39.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6f46aaab-42e7-43ee-8a7f-5b8a6a499b88 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19982025-01-02T23:46:40.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3724ad60-bf19-4cb0-8b11-9697f9987d72 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
19992025-01-02T23:46:40.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3724ad60-bf19-4cb0-8b11-9697f9987d72 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20002025-01-02T23:46:40.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3724ad60-bf19-4cb0-8b11-9697f9987d72 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20012025-01-02T23:46:41.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d9e2b56c-5951-40fe-82da-2b24d2e6ff02 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20022025-01-02T23:46:41.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d9e2b56c-5951-40fe-82da-2b24d2e6ff02 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20032025-01-02T23:46:41.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d9e2b56c-5951-40fe-82da-2b24d2e6ff02 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20042025-01-02T23:46:42.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1e073aba-aab1-42ff-9250-75ad7de0b86d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20052025-01-02T23:46:42.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1e073aba-aab1-42ff-9250-75ad7de0b86d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20062025-01-02T23:46:42.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1e073aba-aab1-42ff-9250-75ad7de0b86d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20072025-01-02T23:46:43.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 60f86480-d15b-4bbf-af1e-8d6f021c699d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20082025-01-02T23:46:43.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 60f86480-d15b-4bbf-af1e-8d6f021c699d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20092025-01-02T23:46:43.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 60f86480-d15b-4bbf-af1e-8d6f021c699d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20102025-01-02T23:46:43.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 475 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = a62533b1-60f9-457f-ba54-b29bc7f69c1d response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
20112025-01-02T23:46:44.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
20122025-01-02T23:46:44.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20132025-01-02T23:46:44.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
20142025-01-02T23:46:44.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20152025-01-02T23:46:44.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20162025-01-02T23:46:44.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20172025-01-02T23:46:44.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20182025-01-02T23:46:44.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20192025-01-02T23:46:44.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20202025-01-02T23:46:44.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20212025-01-02T23:46:44.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20222025-01-02T23:46:44.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20232025-01-02T23:46:44.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20242025-01-02T23:46:44.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20252025-01-02T23:46:44.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262025-01-02T23:46:44.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
20272025-01-02T23:46:44.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20282025-01-02T23:46:44.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20292025-01-02T23:46:44.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.209336ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20302025-01-02T23:46:44.502ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
20312025-01-02T23:46:44.502ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.778059ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
20322025-01-02T23:46:44.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4cc7166f-6521-4aa4-a548-ff802567c87b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20332025-01-02T23:46:44.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4cc7166f-6521-4aa4-a548-ff802567c87b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20342025-01-02T23:46:44.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4cc7166f-6521-4aa4-a548-ff802567c87b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20352025-01-02T23:46:45.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6ab6e039-484e-4c91-ac53-75b2d445c154 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20362025-01-02T23:46:45.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6ab6e039-484e-4c91-ac53-75b2d445c154 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20372025-01-02T23:46:45.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6ab6e039-484e-4c91-ac53-75b2d445c154 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20382025-01-02T23:46:46.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d7f75bd9-e2e9-4379-b467-49b9283093ff roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20392025-01-02T23:46:46.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d7f75bd9-e2e9-4379-b467-49b9283093ff resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20402025-01-02T23:46:46.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d7f75bd9-e2e9-4379-b467-49b9283093ff response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20412025-01-02T23:46:47.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 235dd139-b374-40e1-85ec-0266ab9dd46e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20422025-01-02T23:46:47.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 235dd139-b374-40e1-85ec-0266ab9dd46e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20432025-01-02T23:46:47.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 235dd139-b374-40e1-85ec-0266ab9dd46e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20442025-01-02T23:46:48.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d9c9ec6b-c5bb-4d90-971e-e85cbd608256 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20452025-01-02T23:46:48.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d9c9ec6b-c5bb-4d90-971e-e85cbd608256 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20462025-01-02T23:46:48.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d9c9ec6b-c5bb-4d90-971e-e85cbd608256 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20472025-01-02T23:46:49.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 2adb1cb5-ff32-4c9b-9329-6d999fd17abf roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20482025-01-02T23:46:49.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 2adb1cb5-ff32-4c9b-9329-6d999fd17abf resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20492025-01-02T23:46:49.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 2adb1cb5-ff32-4c9b-9329-6d999fd17abf response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20502025-01-02T23:46:50.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8308e1f8-0b2a-46eb-8f07-2fb060582e4b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20512025-01-02T23:46:50.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8308e1f8-0b2a-46eb-8f07-2fb060582e4b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20522025-01-02T23:46:50.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8308e1f8-0b2a-46eb-8f07-2fb060582e4b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20532025-01-02T23:46:51.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 15341f7d-55e8-4926-a68d-d31ed8328409 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20542025-01-02T23:46:51.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 15341f7d-55e8-4926-a68d-d31ed8328409 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20552025-01-02T23:46:51.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 15341f7d-55e8-4926-a68d-d31ed8328409 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20562025-01-02T23:46:52.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 20e6b190-0db4-4c48-b00f-96978c03436d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20572025-01-02T23:46:52.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 20e6b190-0db4-4c48-b00f-96978c03436d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20582025-01-02T23:46:52.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 20e6b190-0db4-4c48-b00f-96978c03436d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20592025-01-02T23:46:53.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 1121baed-c540-495c-8b46-ae47bccb6a70 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
20602025-01-02T23:46:53.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 42ffb952-d606-48c2-9fa0-fbfd0b8f491d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20612025-01-02T23:46:53.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 42ffb952-d606-48c2-9fa0-fbfd0b8f491d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20622025-01-02T23:46:53.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 42ffb952-d606-48c2-9fa0-fbfd0b8f491d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20632025-01-02T23:46:54.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
20642025-01-02T23:46:54.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
20652025-01-02T23:46:54.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20662025-01-02T23:46:54.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20672025-01-02T23:46:54.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20682025-01-02T23:46:54.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20692025-01-02T23:46:54.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20702025-01-02T23:46:54.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20712025-01-02T23:46:54.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.180623ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20722025-01-02T23:46:54.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20732025-01-02T23:46:54.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20742025-01-02T23:46:54.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20752025-01-02T23:46:54.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20762025-01-02T23:46:54.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20772025-01-02T23:46:54.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20782025-01-02T23:46:54.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20792025-01-02T23:46:54.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
20802025-01-02T23:46:54.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20812025-01-02T23:46:54.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20822025-01-02T23:46:54.477ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
20832025-01-02T23:46:54.477ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.482406ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
20842025-01-02T23:46:54.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cb5f192b-2f66-401e-963f-cd8f5d27cfeb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20852025-01-02T23:46:54.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cb5f192b-2f66-401e-963f-cd8f5d27cfeb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20862025-01-02T23:46:54.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cb5f192b-2f66-401e-963f-cd8f5d27cfeb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20872025-01-02T23:46:55.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cf9fb522-b21e-4fc7-80ee-169fa05123ca roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20882025-01-02T23:46:55.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cf9fb522-b21e-4fc7-80ee-169fa05123ca resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20892025-01-02T23:46:55.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cf9fb522-b21e-4fc7-80ee-169fa05123ca response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20902025-01-02T23:46:56.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3efb9101-9d23-4a7d-be21-2d26e755909d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20912025-01-02T23:46:56.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3efb9101-9d23-4a7d-be21-2d26e755909d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20922025-01-02T23:46:56.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3efb9101-9d23-4a7d-be21-2d26e755909d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20932025-01-02T23:46:57.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 35be784a-dedb-4313-afac-896d213dbc77 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20942025-01-02T23:46:57.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 35be784a-dedb-4313-afac-896d213dbc77 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20952025-01-02T23:46:57.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 35be784a-dedb-4313-afac-896d213dbc77 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20962025-01-02T23:46:58.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 98e12dcd-5fb4-4b56-b219-9137ac766a8d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20972025-01-02T23:46:58.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 98e12dcd-5fb4-4b56-b219-9137ac766a8d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20982025-01-02T23:46:58.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 98e12dcd-5fb4-4b56-b219-9137ac766a8d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
20992025-01-02T23:47:00.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = dc932f09-e783-434c-80e9-da391c4ee8eb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21002025-01-02T23:47:00.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = dc932f09-e783-434c-80e9-da391c4ee8eb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21012025-01-02T23:47:00.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = dc932f09-e783-434c-80e9-da391c4ee8eb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21022025-01-02T23:47:01.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d0289b62-835e-45c3-b246-9923bc447bd0 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21032025-01-02T23:47:01.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d0289b62-835e-45c3-b246-9923bc447bd0 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21042025-01-02T23:47:01.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d0289b62-835e-45c3-b246-9923bc447bd0 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21052025-01-02T23:47:02.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6471f56d-aecc-4e0f-bb02-a16313abe91e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21062025-01-02T23:47:02.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6471f56d-aecc-4e0f-bb02-a16313abe91e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21072025-01-02T23:47:02.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6471f56d-aecc-4e0f-bb02-a16313abe91e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21082025-01-02T23:47:03.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e79106dc-2965-4c7a-a660-eb4592bb1bc4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21092025-01-02T23:47:03.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e79106dc-2965-4c7a-a660-eb4592bb1bc4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21102025-01-02T23:47:03.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e79106dc-2965-4c7a-a660-eb4592bb1bc4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21112025-01-02T23:47:03.720ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 008d30c0-3118-4634-8bb8-75190ea6d4b7 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
21122025-01-02T23:47:04.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 97a6d264-c3d3-4115-af05-bde4e1c524d0 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21132025-01-02T23:47:04.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 97a6d264-c3d3-4115-af05-bde4e1c524d0 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21142025-01-02T23:47:04.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 97a6d264-c3d3-4115-af05-bde4e1c524d0 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
21152025-01-02T23:47:04.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
21162025-01-02T23:47:04.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
21172025-01-02T23:47:04.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21182025-01-02T23:47:04.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21192025-01-02T23:47:04.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21202025-01-02T23:47:04.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("21a27c6b-77bd-4944-8154-b74f56d79cee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("edeee364-a24a-4b1f-a2f2-141a71f809d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("edeee364-a24a-4b1f-a2f2-141a71f809d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 743491955 } })
21212025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
21222025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
21232025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
21242025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21252025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
21262025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
21272025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21282025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
21292025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
21302025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21312025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21322025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
21332025-01-02T23:47:04.423ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-02 23:37:04.423207676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21342025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21352025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
21362025-01-02T23:47:04.423ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = baf806d8-eb74-4256-91bc-030ba749ae9d
21372025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21382025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
21392025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.27\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d"}
21402025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21412025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
21422025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
21432025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21442025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21452025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
21462025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21472025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
21482025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
21492025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21502025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21512025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
21522025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21532025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
21542025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21552025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21562025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
21572025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21582025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
21592025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21602025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21612025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
21622025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
21632025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21642025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21652025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21662025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
21672025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
21682025-01-02T23:47:04.423ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21692025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21702025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21712025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
21722025-01-02T23:47:04.423ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21732025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21742025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
21752025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
21762025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
21772025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21782025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
21792025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21802025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
21812025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21822025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21832025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21842025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21852025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21862025-01-02T23:47:04.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21872025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21882025-01-02T23:47:04.424ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3cf11230-2b59-4cce-bb9f-d43f7cd85242.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cf07b438-4026-4d20-a0d8-212a50bca0d8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cf07b438-4026-4d20-a0d8-212a50bca0d8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 744522528 } })
21892025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21902025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21912025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21922025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21932025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21942025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21952025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21962025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21972025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
21982025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
21992025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22002025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22012025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22022025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
22032025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.747893ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
22042025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22052025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22062025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22072025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
22082025-01-02T23:47:04.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.339397ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
22092025-01-02T23:47:04.426ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-02 23:37:04.423207676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22102025-01-02T23:47:04.426ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.438795ms iteration = 14 status = {"expiration":"2025-01-02T23:37:04.423207676Z","pruned":[]}
22112025-01-02T23:47:04.426ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22122025-01-02T23:47:04.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22132025-01-02T23:47:04.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22142025-01-02T23:47:04.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22152025-01-02T23:47:04.427ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.390787ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22162025-01-02T23:47:04.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22172025-01-02T23:47:04.428ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 748857405 } })
22182025-01-02T23:47:04.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
22192025-01-02T23:47:04.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22202025-01-02T23:47:04.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22212025-01-02T23:47:04.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22222025-01-02T23:47:04.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22232025-01-02T23:47:04.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22242025-01-02T23:47:04.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22252025-01-02T23:47:04.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22262025-01-02T23:47:04.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22272025-01-02T23:47:04.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22282025-01-02T23:47:04.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.42341ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
22292025-01-02T23:47:04.436ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.135963ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
22302025-01-02T23:47:04.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22312025-01-02T23:47:04.439ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 759763518 } })
22322025-01-02T23:47:04.439ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
22332025-01-02T23:47:04.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22342025-01-02T23:47:04.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22352025-01-02T23:47:04.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22362025-01-02T23:47:04.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22372025-01-02T23:47:04.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22382025-01-02T23:47:04.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22392025-01-02T23:47:04.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22402025-01-02T23:47:04.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22412025-01-02T23:47:04.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22422025-01-02T23:47:04.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22432025-01-02T23:47:04.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22442025-01-02T23:47:04.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22452025-01-02T23:47:04.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22462025-01-02T23:47:04.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22472025-01-02T23:47:04.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22482025-01-02T23:47:04.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492025-01-02T23:47:04.473ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22502025-01-02T23:47:04.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22512025-01-02T23:47:04.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22522025-01-02T23:47:04.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22532025-01-02T23:47:04.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22542025-01-02T23:47:04.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22552025-01-02T23:47:04.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22562025-01-02T23:47:04.475ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22572025-01-02T23:47:04.475ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22582025-01-02T23:47:04.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22592025-01-02T23:47:04.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22602025-01-02T23:47:04.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22612025-01-02T23:47:04.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.269397ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
22622025-01-02T23:47:04.478ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22632025-01-02T23:47:04.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22642025-01-02T23:47:04.479ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22652025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22662025-01-02T23:47:04.480ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22672025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22682025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22692025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22702025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22712025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22722025-01-02T23:47:04.480ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
22732025-01-02T23:47:04.480ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
22742025-01-02T23:47:04.481ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.438926ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
22752025-01-02T23:47:04.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22762025-01-02T23:47:04.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22772025-01-02T23:47:04.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22782025-01-02T23:47:04.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22792025-01-02T23:47:04.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22802025-01-02T23:47:04.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22812025-01-02T23:47:04.484ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22822025-01-02T23:47:04.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22832025-01-02T23:47:04.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22842025-01-02T23:47:04.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22852025-01-02T23:47:04.487ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22862025-01-02T23:47:04.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22872025-01-02T23:47:04.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22882025-01-02T23:47:04.489ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 809659304 } })
22892025-01-02T23:47:04.489ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
22902025-01-02T23:47:04.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22912025-01-02T23:47:04.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22922025-01-02T23:47:04.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22932025-01-02T23:47:04.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22942025-01-02T23:47:04.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22952025-01-02T23:47:04.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22962025-01-02T23:47:04.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972025-01-02T23:47:04.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22982025-01-02T23:47:04.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22992025-01-02T23:47:04.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
23002025-01-02T23:47:04.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23012025-01-02T23:47:04.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23022025-01-02T23:47:04.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032025-01-02T23:47:04.502ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23042025-01-02T23:47:04.502ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.038979ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23052025-01-02T23:47:04.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8a1161d7-6d62-4983-bc09-f43d060ae472, lookup_type: ById(8a1161d7-6d62-4983-bc09-f43d060ae472) } result = Ok(())
23062025-01-02T23:47:04.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23072025-01-02T23:47:04.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23082025-01-02T23:47:04.508ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.102959ms iteration = 27 status = 0
23092025-01-02T23:47:04.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23102025-01-02T23:47:04.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23112025-01-02T23:47:04.516ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
23122025-01-02T23:47:04.516ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.686922ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
23132025-01-02T23:47:04.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.621514ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23142025-01-02T23:47:04.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23152025-01-02T23:47:04.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23162025-01-02T23:47:04.523ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23172025-01-02T23:47:04.523ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23182025-01-02T23:47:04.523ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23192025-01-02T23:47:04.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23202025-01-02T23:47:04.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23212025-01-02T23:47:04.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.545224ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23222025-01-02T23:47:04.528ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23232025-01-02T23:47:04.528ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23242025-01-02T23:47:04.528ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23252025-01-02T23:47:04.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23262025-01-02T23:47:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23272025-01-02T23:47:04.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.809474ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23282025-01-02T23:47:04.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292025-01-02T23:47:04.531ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23302025-01-02T23:47:04.531ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23312025-01-02T23:47:04.531ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.241112ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23322025-01-02T23:47:04.531ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23332025-01-02T23:47:04.531ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23342025-01-02T23:47:04.531ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 108.275463ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23352025-01-02T23:47:04.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23362025-01-02T23:47:04.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23372025-01-02T23:47:04.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23382025-01-02T23:47:04.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23392025-01-02T23:47:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23402025-01-02T23:47:04.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23412025-01-02T23:47:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23422025-01-02T23:47:04.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.326213ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23432025-01-02T23:47:04.550ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23442025-01-02T23:47:04.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23452025-01-02T23:47:04.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23462025-01-02T23:47:04.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23472025-01-02T23:47:04.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23482025-01-02T23:47:04.568ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23492025-01-02T23:47:04.568ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a8c4f8d-ef7b-4396-aa86-4770ac83fa25 dns_zone_name = oxide.test found_so_far = 0 version = 2
23502025-01-02T23:47:04.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23512025-01-02T23:47:04.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23522025-01-02T23:47:04.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23532025-01-02T23:47:04.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23542025-01-02T23:47:04.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23552025-01-02T23:47:04.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23562025-01-02T23:47:04.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23572025-01-02T23:47:04.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23582025-01-02T23:47:04.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23592025-01-02T23:47:04.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23602025-01-02T23:47:04.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23612025-01-02T23:47:04.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23622025-01-02T23:47:04.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23632025-01-02T23:47:04.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23642025-01-02T23:47:04.575ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a8c4f8d-ef7b-4396-aa86-4770ac83fa25 dns_zone_name = oxide.test found_so_far = 1 version = 2
23652025-01-02T23:47:04.575ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23662025-01-02T23:47:04.575ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-02 23:34:09.381030 UTC dns_group = external generation = 2
23672025-01-02T23:47:04.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.266561ms iteration = 14 status = {"generation":2}
23682025-01-02T23:47:04.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23692025-01-02T23:47:04.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23702025-01-02T23:47:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.641702ms iteration = 30 status = {"physical_disks_added":0}
23712025-01-02T23:47:04.587ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23722025-01-02T23:47:04.587ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23732025-01-02T23:47:04.587ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09fec559-2a00-406a-9107-1d9fdb3b9efc", "content-length": "26", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
23742025-01-02T23:47:04.587ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23752025-01-02T23:47:04.587ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23762025-01-02T23:47:04.587ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 074636c4-f52c-4c82-954e-efd9d4812db6 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23772025-01-02T23:47:04.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23782025-01-02T23:47:04.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23792025-01-02T23:47:04.589ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23802025-01-02T23:47:04.613ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-02T23:33:58.545542Z, time_modified: 2025-01-02T23:33:58.545542Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, db_silo: Silo { identity: SiloIdentity { id: 31564a6d-adef-486f-8af0-44d369c942f7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-02T23:34:09.297095Z, time_modified: 2025-01-02T23:34:09.297095Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, db_silo: Silo { identity: SiloIdentity { id: 31564a6d-adef-486f-8af0-44d369c942f7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-02T23:34:09.297095Z, time_modified: 2025-01-02T23:34:09.297095Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f" }] }) }
23812025-01-02T23:47:04.613ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 189.958077ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"31564a6d-adef-486f-8af0-44d369c942f7","tls_certs":["57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f"]}},"default_endpoint":{"silo_id":"31564a6d-adef-486f-8af0-44d369c942f7","tls_certs":["57d1d0451954738c2b77406e0ecd893496a35dd9b0a8eb588b72e2e7e277328f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23822025-01-02T23:47:04.616ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23832025-01-02T23:47:04.616ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 193.024517ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23842025-01-02T23:47:04.755ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23852025-01-02T23:47:04.762ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.568144ms iteration = 27 status = {}
23862025-01-02T23:47:04.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23872025-01-02T23:47:04.818ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23882025-01-02T23:47:04.818ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d15e4362-f775-45f6-9c9d-df883c9f9dfb", "content-length": "26", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
23892025-01-02T23:47:04.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23902025-01-02T23:47:04.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23912025-01-02T23:47:04.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a zone_address = fd00:1122:3344:101::2
23922025-01-02T23:47:04.864ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23932025-01-02T23:47:04.864ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3675bae-4bbe-4998-ad74-c174bcd22a79", "content-length": "26", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
23942025-01-02T23:47:04.864ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23952025-01-02T23:47:04.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
23962025-01-02T23:47:04.894ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23972025-01-02T23:47:04.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23982025-01-02T23:47:04.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "653cf18e-e862-4102-841c-f93fd981107d", "content-length": "372", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
23992025-01-02T23:47:04.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24002025-01-02T23:47:04.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24012025-01-02T23:47:04.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24022025-01-02T23:47:04.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24032025-01-02T23:47:04.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24042025-01-02T23:47:04.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24052025-01-02T23:47:04.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24062025-01-02T23:47:04.902ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 074636c4-f52c-4c82-954e-efd9d4812db6 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24072025-01-02T23:47:04.902ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24082025-01-02T23:47:04.902ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-02 23:34:06.342386 UTC dns_group = internal generation = 1
24092025-01-02T23:47:04.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 480.258823ms iteration = 14 status = {"generation":1}
24102025-01-02T23:47:04.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112025-01-02T23:47:04.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24122025-01-02T23:47:04.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24132025-01-02T23:47:04.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24142025-01-02T23:47:04.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24152025-01-02T23:47:04.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24162025-01-02T23:47:04.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24172025-01-02T23:47:04.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24182025-01-02T23:47:04.939ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24192025-01-02T23:47:04.940ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24202025-01-02T23:47:04.940ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e692e1f0-34d2-4f55-b60c-acbcf3874e71", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24212025-01-02T23:47:04.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24222025-01-02T23:47:04.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24232025-01-02T23:47:04.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24242025-01-02T23:47:04.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24252025-01-02T23:47:04.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24262025-01-02T23:47:04.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24272025-01-02T23:47:04.949ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24282025-01-02T23:47:04.949ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24292025-01-02T23:47:04.950ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "45987ad4-37aa-4463-b82a-47202d5cca24", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24302025-01-02T23:47:04.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24312025-01-02T23:47:04.951ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7aeb2613-b4da-4c4b-876d-e65a4f0d9630", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24322025-01-02T23:47:04.951ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24332025-01-02T23:47:04.951ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 528.419545ms iteration = 28 status = {}
24342025-01-02T23:47:04.953ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "009c3bad-a2a5-4ee3-a2b9-30a4c2ff9a39", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24352025-01-02T23:47:04.953ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24362025-01-02T23:47:04.955ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24372025-01-02T23:47:04.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 532.198566ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24382025-01-02T23:47:05.063ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24392025-01-02T23:47:05.063ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5438728e-a185-464c-b679-066028dcbe78", "content-length": "2", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24402025-01-02T23:47:05.065ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24412025-01-02T23:47:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24422025-01-02T23:47:05.067ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 644.340069ms iteration = 27 status = null
24432025-01-02T23:47:05.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24442025-01-02T23:47:05.074ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86307e2c-f396-4075-ae12-353ab055e767", "content-length": "691", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24452025-01-02T23:47:05.074ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24462025-01-02T23:47:05.074ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24472025-01-02T23:47:05.074ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24482025-01-02T23:47:05.077ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 653.681462ms iteration = 28 status = {}
24492025-01-02T23:47:05.079ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24502025-01-02T23:47:05.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e5c86fba-cc83-433a-a726-ae3977d03eb5", "date": "Thu, 02 Jan 2025 23:47:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24512025-01-02T23:47:05.079ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24522025-01-02T23:47:05.081ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2fa8dc6e-bc54-4e12-b258-d7d8709d93b1", "date": "Thu, 02 Jan 2025 23:47:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24532025-01-02T23:47:05.081ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24542025-01-02T23:47:05.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "070971a8-c58e-47a1-9618-df38201e8f90", "date": "Thu, 02 Jan 2025 23:47:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24552025-01-02T23:47:05.082ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24562025-01-02T23:47:05.085ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24572025-01-02T23:47:05.085ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 661.527245ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24582025-01-02T23:47:05.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24592025-01-02T23:47:05.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24602025-01-02T23:47:05.112ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 74b7adc4-e4eb-4c16-b1dc-cfb7bdc9491d, rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a88f93f1-cd0a-4937-aa27-b4266d8f17ee) } rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
24612025-01-02T23:47:05.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24622025-01-02T23:47:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24632025-01-02T23:47:05.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3f52daef-0d1a-4a73-b208-dba30685e213 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
24642025-01-02T23:47:05.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3f52daef-0d1a-4a73-b208-dba30685e213 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
24652025-01-02T23:47:05.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3f52daef-0d1a-4a73-b208-dba30685e213 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
24662025-01-02T23:47:05.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24672025-01-02T23:47:05.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf532807-97b8-40d2-a2b8-08dcf9302dfc", "content-length": "134", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24682025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24692025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a88f93f1-cd0a-4937-aa27-b4266d8f17ee
24702025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24712025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24722025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24732025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24742025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24752025-01-02T23:47:05.123ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24762025-01-02T23:47:05.124ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24772025-01-02T23:47:05.124ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24782025-01-02T23:47:05.124ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
24792025-01-02T23:47:05.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24802025-01-02T23:47:05.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24812025-01-02T23:47:05.126ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24822025-01-02T23:47:05.126ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "25111c3a-d0d4-4f0d-b3eb-add3f36de2df", "content-length": "2", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24832025-01-02T23:47:05.126ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24842025-01-02T23:47:05.126ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3052914-8198-4884-9da7-d239ec26166b", "content-length": "52", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24852025-01-02T23:47:05.126ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
24862025-01-02T23:47:05.126ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24872025-01-02T23:47:05.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "30338a54-dda2-4970-a099-c200c4f06fb9", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24882025-01-02T23:47:05.214ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch = Switch0
24892025-01-02T23:47:05.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24902025-01-02T23:47:05.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7b26fa5-9d1f-4c2d-8114-4e714ced9320", "content-length": "682", "date": "Thu, 02 Jan 2025 23:47:04 GMT"} })
24912025-01-02T23:47:05.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24922025-01-02T23:47:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24932025-01-02T23:47:05.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24942025-01-02T23:47:05.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24952025-01-02T23:47:05.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24962025-01-02T23:47:05.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24972025-01-02T23:47:05.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24982025-01-02T23:47:05.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24992025-01-02T23:47:05.230ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 807.300861ms iteration = 27 status = {}
25002025-01-02T23:47:06.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b6a3b1f4-d366-44d3-b394-d3a7f212b093 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25012025-01-02T23:47:06.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b6a3b1f4-d366-44d3-b394-d3a7f212b093 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25022025-01-02T23:47:06.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b6a3b1f4-d366-44d3-b394-d3a7f212b093 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25032025-01-02T23:47:07.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = be8177c7-b8b5-4b23-95dd-4d9fd42e374a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25042025-01-02T23:47:07.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = be8177c7-b8b5-4b23-95dd-4d9fd42e374a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25052025-01-02T23:47:07.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = be8177c7-b8b5-4b23-95dd-4d9fd42e374a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25062025-01-02T23:47:08.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 57e47dff-e9ed-4baf-84f6-a2f509420140 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25072025-01-02T23:47:08.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 57e47dff-e9ed-4baf-84f6-a2f509420140 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25082025-01-02T23:47:08.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 57e47dff-e9ed-4baf-84f6-a2f509420140 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25092025-01-02T23:47:09.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 44e3a123-38ce-467c-a372-195d48e82ebb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25102025-01-02T23:47:09.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 44e3a123-38ce-467c-a372-195d48e82ebb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25112025-01-02T23:47:09.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 44e3a123-38ce-467c-a372-195d48e82ebb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25122025-01-02T23:47:10.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ded5bfb6-ac35-4ada-8122-6777eccaf08d roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25132025-01-02T23:47:10.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ded5bfb6-ac35-4ada-8122-6777eccaf08d resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25142025-01-02T23:47:10.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ded5bfb6-ac35-4ada-8122-6777eccaf08d response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25152025-01-02T23:47:11.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b0d66d1a-3774-450d-a475-3e5de32c15af roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25162025-01-02T23:47:11.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b0d66d1a-3774-450d-a475-3e5de32c15af resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25172025-01-02T23:47:11.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b0d66d1a-3774-450d-a475-3e5de32c15af response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25182025-01-02T23:47:12.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cafd5f37-42cd-43a5-ae7b-ea871c4150e0 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25192025-01-02T23:47:12.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cafd5f37-42cd-43a5-ae7b-ea871c4150e0 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25202025-01-02T23:47:12.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cafd5f37-42cd-43a5-ae7b-ea871c4150e0 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25212025-01-02T23:47:13.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 66bae923-85c2-46b5-8f12-954becdd7629 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25222025-01-02T23:47:13.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 66bae923-85c2-46b5-8f12-954becdd7629 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25232025-01-02T23:47:13.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 66bae923-85c2-46b5-8f12-954becdd7629 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25242025-01-02T23:47:13.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 32c2119b-29ac-49c1-848c-dee72663b511 response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
25252025-01-02T23:47:14.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
25262025-01-02T23:47:14.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25272025-01-02T23:47:14.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
25282025-01-02T23:47:14.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25292025-01-02T23:47:14.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25302025-01-02T23:47:14.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25312025-01-02T23:47:14.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322025-01-02T23:47:14.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25332025-01-02T23:47:14.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25342025-01-02T23:47:14.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25352025-01-02T23:47:14.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25362025-01-02T23:47:14.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25372025-01-02T23:47:14.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25382025-01-02T23:47:14.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25392025-01-02T23:47:14.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25402025-01-02T23:47:14.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
25412025-01-02T23:47:14.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25422025-01-02T23:47:14.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25432025-01-02T23:47:14.473ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
25442025-01-02T23:47:14.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.555221ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
25452025-01-02T23:47:14.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = eab45a9d-2db7-4aa9-bac7-585c42d89ffb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25462025-01-02T23:47:14.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = eab45a9d-2db7-4aa9-bac7-585c42d89ffb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25472025-01-02T23:47:14.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = eab45a9d-2db7-4aa9-bac7-585c42d89ffb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25482025-01-02T23:47:14.487ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.037139ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25492025-01-02T23:47:15.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b54d7ee4-2de6-489b-959e-f91c13add70a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25502025-01-02T23:47:15.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b54d7ee4-2de6-489b-959e-f91c13add70a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25512025-01-02T23:47:15.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = b54d7ee4-2de6-489b-959e-f91c13add70a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25522025-01-02T23:47:16.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 375093fa-5424-464e-9939-1342820b4aea roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25532025-01-02T23:47:16.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 375093fa-5424-464e-9939-1342820b4aea resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25542025-01-02T23:47:16.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 375093fa-5424-464e-9939-1342820b4aea response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25552025-01-02T23:47:17.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 35a5a9e3-6eb9-4320-9641-b2082c30c009 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25562025-01-02T23:47:17.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 35a5a9e3-6eb9-4320-9641-b2082c30c009 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25572025-01-02T23:47:17.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 35a5a9e3-6eb9-4320-9641-b2082c30c009 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25582025-01-02T23:47:18.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1b269dc-55b8-49ab-be41-3098cea96dd4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25592025-01-02T23:47:18.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1b269dc-55b8-49ab-be41-3098cea96dd4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25602025-01-02T23:47:18.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1b269dc-55b8-49ab-be41-3098cea96dd4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25612025-01-02T23:47:19.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 152ec8c3-c49a-46aa-9c67-755e337c0eba roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25622025-01-02T23:47:19.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 152ec8c3-c49a-46aa-9c67-755e337c0eba resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25632025-01-02T23:47:19.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 152ec8c3-c49a-46aa-9c67-755e337c0eba response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25642025-01-02T23:47:20.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cf8fd24e-3b63-4400-8877-22461f8d265f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25652025-01-02T23:47:20.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cf8fd24e-3b63-4400-8877-22461f8d265f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25662025-01-02T23:47:20.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = cf8fd24e-3b63-4400-8877-22461f8d265f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25672025-01-02T23:47:21.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9e686f24-f559-4866-8c98-b0133bddedfb roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25682025-01-02T23:47:21.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9e686f24-f559-4866-8c98-b0133bddedfb resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25692025-01-02T23:47:21.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 9e686f24-f559-4866-8c98-b0133bddedfb response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25702025-01-02T23:47:22.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 82db6ddd-14f8-4017-bc47-5b0af4918826 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25712025-01-02T23:47:22.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 82db6ddd-14f8-4017-bc47-5b0af4918826 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25722025-01-02T23:47:22.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 82db6ddd-14f8-4017-bc47-5b0af4918826 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25732025-01-02T23:47:23.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e659a66a-fa1b-4f02-8cb5-d249c10cd871 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25742025-01-02T23:47:23.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e659a66a-fa1b-4f02-8cb5-d249c10cd871 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25752025-01-02T23:47:23.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e659a66a-fa1b-4f02-8cb5-d249c10cd871 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25762025-01-02T23:47:23.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 0f8197aa-4015-4d2d-aa26-99ef8fe311bb response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
25772025-01-02T23:47:24.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
25782025-01-02T23:47:24.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25792025-01-02T23:47:24.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
25802025-01-02T23:47:24.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25812025-01-02T23:47:24.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25822025-01-02T23:47:24.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25832025-01-02T23:47:24.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25842025-01-02T23:47:24.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25852025-01-02T23:47:24.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25862025-01-02T23:47:24.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25872025-01-02T23:47:24.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25882025-01-02T23:47:24.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25892025-01-02T23:47:24.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25902025-01-02T23:47:24.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25912025-01-02T23:47:24.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922025-01-02T23:47:24.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
25932025-01-02T23:47:24.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942025-01-02T23:47:24.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25952025-01-02T23:47:24.475ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
25962025-01-02T23:47:24.475ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.627519ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
25972025-01-02T23:47:24.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.289513ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25982025-01-02T23:47:24.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1d591f3-7d90-4f0d-aefb-ea5698b2c7fa roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
25992025-01-02T23:47:24.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1d591f3-7d90-4f0d-aefb-ea5698b2c7fa resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26002025-01-02T23:47:24.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e1d591f3-7d90-4f0d-aefb-ea5698b2c7fa response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26012025-01-02T23:47:25.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8c98c254-c9d5-4ec6-9620-d47fb2c395b7 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26022025-01-02T23:47:25.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8c98c254-c9d5-4ec6-9620-d47fb2c395b7 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26032025-01-02T23:47:25.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8c98c254-c9d5-4ec6-9620-d47fb2c395b7 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26042025-01-02T23:47:26.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 014fd154-b36b-4b18-b99c-29583b1d8709 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26052025-01-02T23:47:26.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 014fd154-b36b-4b18-b99c-29583b1d8709 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26062025-01-02T23:47:26.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 014fd154-b36b-4b18-b99c-29583b1d8709 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26072025-01-02T23:47:27.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 50008d7c-2ae6-421e-b8b0-dd7adfbccbc4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26082025-01-02T23:47:27.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 50008d7c-2ae6-421e-b8b0-dd7adfbccbc4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26092025-01-02T23:47:27.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 50008d7c-2ae6-421e-b8b0-dd7adfbccbc4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26102025-01-02T23:47:28.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d7a3bc7a-b1f6-4e89-b09a-7bb250bf04db roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26112025-01-02T23:47:28.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d7a3bc7a-b1f6-4e89-b09a-7bb250bf04db resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26122025-01-02T23:47:28.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = d7a3bc7a-b1f6-4e89-b09a-7bb250bf04db response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26132025-01-02T23:47:29.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bdc99211-41bc-43ed-8944-3273d7e38159 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26142025-01-02T23:47:29.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bdc99211-41bc-43ed-8944-3273d7e38159 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26152025-01-02T23:47:29.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bdc99211-41bc-43ed-8944-3273d7e38159 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26162025-01-02T23:47:30.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e5679f09-d14c-420f-8846-c78b0e895463 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26172025-01-02T23:47:30.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e5679f09-d14c-420f-8846-c78b0e895463 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26182025-01-02T23:47:30.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = e5679f09-d14c-420f-8846-c78b0e895463 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26192025-01-02T23:47:31.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3a093617-697c-4ca9-ab2d-cbeb92b9fb2f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26202025-01-02T23:47:31.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3a093617-697c-4ca9-ab2d-cbeb92b9fb2f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26212025-01-02T23:47:31.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 3a093617-697c-4ca9-ab2d-cbeb92b9fb2f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26222025-01-02T23:47:32.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1c6583fc-2926-4671-a896-1cce58b53561 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26232025-01-02T23:47:32.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1c6583fc-2926-4671-a896-1cce58b53561 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26242025-01-02T23:47:32.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1c6583fc-2926-4671-a896-1cce58b53561 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26252025-01-02T23:47:33.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = 9bb8825b-3af6-488e-80e1-11f81797411d response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
26262025-01-02T23:47:33.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4f5b3cf1-0b62-4f9a-a0b8-8f9dad9e4ba8 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26272025-01-02T23:47:33.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4f5b3cf1-0b62-4f9a-a0b8-8f9dad9e4ba8 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26282025-01-02T23:47:33.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4f5b3cf1-0b62-4f9a-a0b8-8f9dad9e4ba8 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
26292025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
26302025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
26312025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
26322025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26332025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26342025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26352025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
26362025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
26372025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26382025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
26392025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26402025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
26412025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26422025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26432025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26442025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
26452025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
26462025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26472025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26482025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
26492025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26502025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
26512025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26522025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
26532025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26542025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
26552025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26562025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
26572025-01-02T23:47:34.423ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26582025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26592025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
26602025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26612025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
26622025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
26632025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26642025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26652025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26662025-01-02T23:47:34.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26672025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26682025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26692025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26702025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26712025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26722025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26732025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26742025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26752025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26762025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26772025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26782025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26792025-01-02T23:47:34.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26802025-01-02T23:47:34.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1775, tv_nsec: 747400986 } })
26812025-01-02T23:47:34.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26822025-01-02T23:47:34.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
26832025-01-02T23:47:34.427ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.148984ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26842025-01-02T23:47:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26852025-01-02T23:47:34.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26862025-01-02T23:47:34.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26872025-01-02T23:47:34.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26882025-01-02T23:47:34.432ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26892025-01-02T23:47:34.432ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26902025-01-02T23:47:34.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26912025-01-02T23:47:34.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1775, tv_nsec: 752528273 } })
26922025-01-02T23:47:34.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26932025-01-02T23:47:34.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
26942025-01-02T23:47:34.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26952025-01-02T23:47:34.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26962025-01-02T23:47:34.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26972025-01-02T23:47:34.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26982025-01-02T23:47:34.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26992025-01-02T23:47:34.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27002025-01-02T23:47:34.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27012025-01-02T23:47:34.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27022025-01-02T23:47:34.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27032025-01-02T23:47:34.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27042025-01-02T23:47:34.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27052025-01-02T23:47:34.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27062025-01-02T23:47:34.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27072025-01-02T23:47:34.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.070006ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
27082025-01-02T23:47:34.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27092025-01-02T23:47:34.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27102025-01-02T23:47:34.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112025-01-02T23:47:34.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27122025-01-02T23:47:34.468ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27132025-01-02T23:47:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27142025-01-02T23:47:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27152025-01-02T23:47:34.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162025-01-02T23:47:34.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27172025-01-02T23:47:34.469ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27182025-01-02T23:47:34.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27192025-01-02T23:47:34.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
27202025-01-02T23:47:34.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27212025-01-02T23:47:34.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27222025-01-02T23:47:34.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27232025-01-02T23:47:34.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27242025-01-02T23:47:34.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27252025-01-02T23:47:34.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27262025-01-02T23:47:34.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.684077ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
27272025-01-02T23:47:34.471ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27282025-01-02T23:47:34.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27292025-01-02T23:47:34.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27302025-01-02T23:47:34.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27312025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27322025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27332025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27342025-01-02T23:47:34.472ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27352025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27362025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27372025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27382025-01-02T23:47:34.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27392025-01-02T23:47:34.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27402025-01-02T23:47:34.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27412025-01-02T23:47:34.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27422025-01-02T23:47:34.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27432025-01-02T23:47:34.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.618461ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27442025-01-02T23:47:34.477ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8a1161d7-6d62-4983-bc09-f43d060ae472.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1775, tv_nsec: 797146680 } })
27452025-01-02T23:47:34.477ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
27462025-01-02T23:47:34.477ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27472025-01-02T23:47:34.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27482025-01-02T23:47:34.479ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27492025-01-02T23:47:34.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27502025-01-02T23:47:34.482ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27512025-01-02T23:47:34.482ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.238898ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27522025-01-02T23:47:34.484ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
27532025-01-02T23:47:34.484ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.312986ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
27542025-01-02T23:47:34.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27552025-01-02T23:47:34.497ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27562025-01-02T23:47:34.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.225395ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27572025-01-02T23:47:34.498ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f80fbeec-7f60-4a9d-88ce-069d86cf5ffa", "content-length": "26", "date": "Thu, 02 Jan 2025 23:47:33 GMT"} })
27582025-01-02T23:47:34.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27592025-01-02T23:47:34.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27602025-01-02T23:47:34.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27612025-01-02T23:47:34.500ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27622025-01-02T23:47:34.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27632025-01-02T23:47:34.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27642025-01-02T23:47:34.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.097979ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27652025-01-02T23:47:34.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.480986ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27662025-01-02T23:47:34.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27672025-01-02T23:47:34.514ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27682025-01-02T23:47:34.514ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "672748de-67bf-476e-947f-69a58d32d931", "content-length": "26", "date": "Thu, 02 Jan 2025 23:47:33 GMT"} })
27692025-01-02T23:47:34.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27702025-01-02T23:47:34.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27712025-01-02T23:47:34.517ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27722025-01-02T23:47:34.517ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27732025-01-02T23:47:34.517ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.951245ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27742025-01-02T23:47:34.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27752025-01-02T23:47:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8a1161d7-6d62-4983-bc09-f43d060ae472, lookup_type: ById(8a1161d7-6d62-4983-bc09-f43d060ae472) } result = Ok(())
27762025-01-02T23:47:34.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27772025-01-02T23:47:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27782025-01-02T23:47:34.541ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.146933ms iteration = 28 status = 0
27792025-01-02T23:47:34.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27802025-01-02T23:47:34.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27812025-01-02T23:47:34.550ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a zone_address = fd00:1122:3344:101::2
27822025-01-02T23:47:34.550ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27832025-01-02T23:47:34.550ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2a90a8-9399-4ca7-b091-642f5ac63792", "content-length": "26", "date": "Thu, 02 Jan 2025 23:47:33 GMT"} })
27842025-01-02T23:47:34.550ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27852025-01-02T23:47:34.552ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
27862025-01-02T23:47:34.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27872025-01-02T23:47:34.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27882025-01-02T23:47:34.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27892025-01-02T23:47:34.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27902025-01-02T23:47:34.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27912025-01-02T23:47:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27922025-01-02T23:47:34.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932025-01-02T23:47:34.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27942025-01-02T23:47:34.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27952025-01-02T23:47:34.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27962025-01-02T23:47:34.577ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.73385ms iteration = 31 status = {"physical_disks_added":0}
27972025-01-02T23:47:34.578ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 155.437233ms iteration = 28 status = {}
27982025-01-02T23:47:34.607ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27992025-01-02T23:47:34.607ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d9fe62-a6d7-4f7c-a553-b687ba5fd989", "content-length": "2", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28002025-01-02T23:47:34.608ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28012025-01-02T23:47:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28022025-01-02T23:47:34.611ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 187.554016ms iteration = 28 status = null
28032025-01-02T23:47:34.625ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28042025-01-02T23:47:34.625ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28052025-01-02T23:47:34.625ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "25930e76-977f-4299-9268-cc8f7e089d0d", "content-length": "372", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28062025-01-02T23:47:34.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28072025-01-02T23:47:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28082025-01-02T23:47:34.638ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28092025-01-02T23:47:34.638ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28102025-01-02T23:47:34.638ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "70b56551-0b8f-409f-b12c-55720ccfa4b4", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28112025-01-02T23:47:34.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28122025-01-02T23:47:34.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28132025-01-02T23:47:34.749ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28142025-01-02T23:47:34.750ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "831e49da-ce46-4718-bb76-b1b23c5702ef", "content-length": "691", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28152025-01-02T23:47:34.750ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28162025-01-02T23:47:34.750ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28172025-01-02T23:47:34.750ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28182025-01-02T23:47:34.751ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 327.518675ms iteration = 29 status = {}
28192025-01-02T23:47:34.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28202025-01-02T23:47:34.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28212025-01-02T23:47:34.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28222025-01-02T23:47:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28232025-01-02T23:47:34.757ZINFOnexus (BackgroundTasks): VPC route manager sled 8a1161d7-6d62-4983-bc09-f43d060ae472 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28242025-01-02T23:47:34.757ZDEBGnexus (BackgroundTasks): client request SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28252025-01-02T23:47:34.757ZDEBGnexus (BackgroundTasks): client response SledAgent = 8a1161d7-6d62-4983-bc09-f43d060ae472 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6415967b-52d6-4d8c-abaa-31d9ba9760e0", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28262025-01-02T23:47:34.759ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 335.595381ms iteration = 29 status = {}
28272025-01-02T23:47:34.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28282025-01-02T23:47:34.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28292025-01-02T23:47:34.791ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 74b7adc4-e4eb-4c16-b1dc-cfb7bdc9491d, rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a88f93f1-cd0a-4937-aa27-b4266d8f17ee) } rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
28302025-01-02T23:47:34.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28312025-01-02T23:47:34.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28322025-01-02T23:47:34.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28332025-01-02T23:47:34.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "acb4928b-e4c0-48df-8fe2-1b947bc18d7b", "content-length": "134", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28342025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28352025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a88f93f1-cd0a-4937-aa27-b4266d8f17ee
28362025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28372025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28382025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28392025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28402025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28412025-01-02T23:47:34.801ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28422025-01-02T23:47:34.802ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28432025-01-02T23:47:34.802ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28442025-01-02T23:47:34.802ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a
28452025-01-02T23:47:34.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28462025-01-02T23:47:34.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28472025-01-02T23:47:34.803ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28482025-01-02T23:47:34.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8394899e-9b01-416f-b11d-0af7d5d6cae3", "content-length": "2", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28492025-01-02T23:47:34.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28502025-01-02T23:47:34.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c931532-f399-45b3-9176-7490eb655ddd", "content-length": "52", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28512025-01-02T23:47:34.804ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch_location = Switch0
28522025-01-02T23:47:34.804ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28532025-01-02T23:47:34.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c2e5717a-87f3-455e-ace6-e6653a8482aa", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28542025-01-02T23:47:34.896ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a switch = Switch0
28552025-01-02T23:47:34.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28562025-01-02T23:47:34.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 14faf6b0-5f4e-4732-8d82-c8856196086a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "23c7269d-931c-45f2-a385-d85458a50611", "content-length": "682", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28572025-01-02T23:47:34.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28582025-01-02T23:47:34.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28592025-01-02T23:47:34.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28602025-01-02T23:47:34.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28612025-01-02T23:47:34.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28622025-01-02T23:47:34.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28632025-01-02T23:47:34.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28642025-01-02T23:47:34.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28652025-01-02T23:47:34.916ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.393605ms iteration = 28 status = {}
28662025-01-02T23:47:34.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 04126225-ab31-4394-96a7-432423037736 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28672025-01-02T23:47:34.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 04126225-ab31-4394-96a7-432423037736 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28682025-01-02T23:47:34.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 04126225-ab31-4394-96a7-432423037736 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28692025-01-02T23:47:35.330ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
28702025-01-02T23:47:35.330ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
28712025-01-02T23:47:35.361ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
28722025-01-02T23:47:35.361ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47893
28732025-01-02T23:47:35.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47893 req_id = 19fc5e2b-f9d1-410b-ac10-15a3708e7920 roles = RoleSet { roles: {} } uri = /metrics/producers
28742025-01-02T23:47:35.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47893 req_id = 19fc5e2b-f9d1-410b-ac10-15a3708e7920 resource = Database result = Ok(()) uri = /metrics/producers
28752025-01-02T23:47:35.398ZINFOnexus: assigned collector to new producer collector_id = b48215cb-c824-4631-91b6-5d65088888bc file = nexus/src/app/oximeter.rs:76 producer_id = 56011122-5ef5-4404-a960-4d469159f36a
28762025-01-02T23:47:35.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37495 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47893 req_id = 19fc5e2b-f9d1-410b-ac10-15a3708e7920 response_code = 201 uri = /metrics/producers
28772025-01-02T23:47:35.398ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "19fc5e2b-f9d1-410b-ac10-15a3708e7920", "content-length": "41", "date": "Thu, 02 Jan 2025 23:47:34 GMT"} })
28782025-01-02T23:47:35.400ZDEBGnexus (producer-registration-task): registered with nexus successfully
28792025-01-02T23:47:35.400ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
28802025-01-02T23:47:35.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8dae290a-bd1d-4349-9f5b-b2e8ca53f3ff roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28812025-01-02T23:47:35.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8dae290a-bd1d-4349-9f5b-b2e8ca53f3ff resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28822025-01-02T23:47:35.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8dae290a-bd1d-4349-9f5b-b2e8ca53f3ff response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28832025-01-02T23:47:36.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4b4a59b8-8420-474b-9680-a7abfdd43c20 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28842025-01-02T23:47:36.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4b4a59b8-8420-474b-9680-a7abfdd43c20 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28852025-01-02T23:47:36.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4b4a59b8-8420-474b-9680-a7abfdd43c20 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28862025-01-02T23:47:37.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 88ad6f36-292f-4e5c-b312-bd9024aade26 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28872025-01-02T23:47:37.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 88ad6f36-292f-4e5c-b312-bd9024aade26 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28882025-01-02T23:47:37.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 88ad6f36-292f-4e5c-b312-bd9024aade26 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28892025-01-02T23:47:39.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c4ede602-23ff-4980-b485-7a6a8df4339f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28902025-01-02T23:47:39.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c4ede602-23ff-4980-b485-7a6a8df4339f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28912025-01-02T23:47:39.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = c4ede602-23ff-4980-b485-7a6a8df4339f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28922025-01-02T23:47:40.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1425c24c-10b6-4c65-928e-5d976c09d60b roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28932025-01-02T23:47:40.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1425c24c-10b6-4c65-928e-5d976c09d60b resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28942025-01-02T23:47:40.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 1425c24c-10b6-4c65-928e-5d976c09d60b response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28952025-01-02T23:47:41.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = da0b2cae-b6f0-42e4-9c53-4b60c0f65eb4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28962025-01-02T23:47:41.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = da0b2cae-b6f0-42e4-9c53-4b60c0f65eb4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28972025-01-02T23:47:41.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = da0b2cae-b6f0-42e4-9c53-4b60c0f65eb4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28982025-01-02T23:47:42.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 042f2eb1-9480-4d98-882d-8ee68c4ccb4f roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
28992025-01-02T23:47:42.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 042f2eb1-9480-4d98-882d-8ee68c4ccb4f resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29002025-01-02T23:47:42.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 042f2eb1-9480-4d98-882d-8ee68c4ccb4f response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29012025-01-02T23:47:43.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ffc91fb0-fc92-4ae1-a7e7-e340cfe5bc69 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29022025-01-02T23:47:43.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ffc91fb0-fc92-4ae1-a7e7-e340cfe5bc69 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29032025-01-02T23:47:43.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ffc91fb0-fc92-4ae1-a7e7-e340cfe5bc69 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29042025-01-02T23:47:43.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = b02d362f-1794-4799-a067-da824360eb3b response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
29052025-01-02T23:47:44.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 39df45d1-3a09-46cf-abbe-0d1d56864c15 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29062025-01-02T23:47:44.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 39df45d1-3a09-46cf-abbe-0d1d56864c15 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29072025-01-02T23:47:44.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 39df45d1-3a09-46cf-abbe-0d1d56864c15 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29082025-01-02T23:47:44.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
29092025-01-02T23:47:44.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
29102025-01-02T23:47:44.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29112025-01-02T23:47:44.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29122025-01-02T23:47:44.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29132025-01-02T23:47:44.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29142025-01-02T23:47:44.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152025-01-02T23:47:44.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29162025-01-02T23:47:44.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29172025-01-02T23:47:44.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29182025-01-02T23:47:44.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29192025-01-02T23:47:44.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29202025-01-02T23:47:44.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29212025-01-02T23:47:44.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
29222025-01-02T23:47:44.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29232025-01-02T23:47:44.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29242025-01-02T23:47:44.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
29252025-01-02T23:47:44.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.654114ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
29262025-01-02T23:47:44.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29272025-01-02T23:47:44.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29282025-01-02T23:47:44.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.435415ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29292025-01-02T23:47:45.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4aed4bc4-f277-49ac-a6ee-1943435897b4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29302025-01-02T23:47:45.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4aed4bc4-f277-49ac-a6ee-1943435897b4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29312025-01-02T23:47:45.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4aed4bc4-f277-49ac-a6ee-1943435897b4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29322025-01-02T23:47:46.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6d003d24-9b9c-4a79-b181-b4c6860bc135 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29332025-01-02T23:47:46.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6d003d24-9b9c-4a79-b181-b4c6860bc135 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29342025-01-02T23:47:46.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 6d003d24-9b9c-4a79-b181-b4c6860bc135 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29352025-01-02T23:47:47.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ada73171-958b-4671-a217-f10b990f9324 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29362025-01-02T23:47:47.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ada73171-958b-4671-a217-f10b990f9324 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29372025-01-02T23:47:47.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = ada73171-958b-4671-a217-f10b990f9324 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29382025-01-02T23:47:48.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 7d768658-f173-426b-b10b-4498f821b3f8 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29392025-01-02T23:47:48.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 7d768658-f173-426b-b10b-4498f821b3f8 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29402025-01-02T23:47:48.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 7d768658-f173-426b-b10b-4498f821b3f8 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29412025-01-02T23:47:49.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = db431fa0-8705-4436-89c1-226612fe6c4e roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29422025-01-02T23:47:49.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = db431fa0-8705-4436-89c1-226612fe6c4e resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29432025-01-02T23:47:49.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = db431fa0-8705-4436-89c1-226612fe6c4e response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29442025-01-02T23:47:50.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 114ee8c0-9973-4266-b707-895adaf1fb92 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29452025-01-02T23:47:50.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 114ee8c0-9973-4266-b707-895adaf1fb92 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29462025-01-02T23:47:50.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 114ee8c0-9973-4266-b707-895adaf1fb92 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29472025-01-02T23:47:51.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5046913e-c659-4972-afd6-e8da999de668 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29482025-01-02T23:47:51.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5046913e-c659-4972-afd6-e8da999de668 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29492025-01-02T23:47:51.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 5046913e-c659-4972-afd6-e8da999de668 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29502025-01-02T23:47:52.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0aeb8b30-b358-40b8-a1cd-a863d7dcb187 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29512025-01-02T23:47:52.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0aeb8b30-b358-40b8-a1cd-a863d7dcb187 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29522025-01-02T23:47:52.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 0aeb8b30-b358-40b8-a1cd-a863d7dcb187 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29532025-01-02T23:47:53.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bc327241-9052-40bb-ab47-f8d2d32375f4 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29542025-01-02T23:47:53.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bc327241-9052-40bb-ab47-f8d2d32375f4 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29552025-01-02T23:47:53.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = bc327241-9052-40bb-ab47-f8d2d32375f4 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29562025-01-02T23:47:53.722ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 472 local_addr = [fd00:1122:3344:101::c]:49062 method = GET remote_addr = [fd00:1122:3344:101::d]:47991 req_id = efb508de-f846-4599-b192-0533565ea6dd response_code = 200 uri = /56011122-5ef5-4404-a960-4d469159f36a
29572025-01-02T23:47:54.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4975603d-3a6f-4cd0-9b4e-f5dca0a6ceb8 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29582025-01-02T23:47:54.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4975603d-3a6f-4cd0-9b4e-f5dca0a6ceb8 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29592025-01-02T23:47:54.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 4975603d-3a6f-4cd0-9b4e-f5dca0a6ceb8 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29602025-01-02T23:47:54.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
29612025-01-02T23:47:54.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
29622025-01-02T23:47:54.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29632025-01-02T23:47:54.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29642025-01-02T23:47:54.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29652025-01-02T23:47:54.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29662025-01-02T23:47:54.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29672025-01-02T23:47:54.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29682025-01-02T23:47:54.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692025-01-02T23:47:54.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.851201ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29702025-01-02T23:47:54.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29712025-01-02T23:47:54.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29722025-01-02T23:47:54.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29732025-01-02T23:47:54.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29742025-01-02T23:47:54.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29752025-01-02T23:47:54.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762025-01-02T23:47:54.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: baf806d8-eb74-4256-91bc-030ba749ae9d, lookup_type: ById(baf806d8-eb74-4256-91bc-030ba749ae9d) } result = Ok(())
29772025-01-02T23:47:54.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29782025-01-02T23:47:54.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29792025-01-02T23:47:54.444ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = baf806d8-eb74-4256-91bc-030ba749ae9d original_time_created = 2025-01-02 23:33:52.275646 UTC target_id = baf806d8-eb74-4256-91bc-030ba749ae9d time_created = 2025-01-02 23:33:52.275646 UTC
29802025-01-02T23:47:54.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.236986ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"baf806d8-eb74-4256-91bc-030ba749ae9d","time_created":"2025-01-02T23:33:52.275646Z"}
29812025-01-02T23:47:55.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f17d14ab-411a-4f5e-805f-5d5356f4487a roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29822025-01-02T23:47:55.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f17d14ab-411a-4f5e-805f-5d5356f4487a resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29832025-01-02T23:47:55.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = f17d14ab-411a-4f5e-805f-5d5356f4487a response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29842025-01-02T23:47:56.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8a430e0a-ea43-4207-bff2-7f804bd790c3 roles = RoleSet { roles: {} } uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29852025-01-02T23:47:56.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8a430e0a-ea43-4207-bff2-7f804bd790c3 resource = Database result = Ok(()) uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472
29862025-01-02T23:47:56.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59558 req_id = 8a430e0a-ea43-4207-bff2-7f804bd790c3 response_code = 200 uri = /probes/8a1161d7-6d62-4983-bc09-f43d060ae472